Coding

Row

Primal Spectral Distance

Row

Primal Spectral Distance

Here is a heatmap of the spectral distances between the Primal Classification Hypegraphs (or Model 1 Hypergraphs), where vertices are cells and hyperedges are cell fates. The hyeprgraphs have been sorted in the heatmap such the species tested on is grouped together. It is clear to see, that all hypergraphs tested on the same species have low spectral distance between them, except for Human 3 who's spectral distance is much closer to mice than it is to humans.

Row

Heatmap

UMAP Representation of Spectral Projection

Row

Dual Spectral Distance

Row

Dual Spectral Distance

Here is a heatmap of the spectral distances between the Dual Classification Hypegraphs (or Model 2 Hypergraphs), where vertices are cell fates and hyperedges are cells. It is harder to immediately analyse these resluts by inspection. There is a definite pattern to the data with respect to the species the classifiers were tested and trained on. It is interesting to note that the spectral distances between all hypergraphs where the classifier was both tested and trained on the same species is low. Oimilarly to the primal case, the pattern in the data is broken by Human 3. The hypergraphs of classifiers trained on Human 3 but then tested on mice has a starkly different heatmap to other similar classifiers.

Row

Heatmap

A Statisic

Confidence/Accuracy

Row

Balanced Accuracy Compared to Spectral Distance From the Disconnected Hypergraph

Row

Average Balanced Accuracy of Intraspecies Classifications

Average Spectral Distance From the Disconnected Hypergraph of Intraspecies Classifications

1.51

Average Balanced Accuracy of Interspecies Classifications

Average Spectral Distance From the Disconnected Hypergraph of Interspecies Classifications

4.88

Row

M1M1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9407407 0.9121531 0.9131074 0.9616662 0.5333333 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9953704 0.9682540 0.9728507 0.9945652 0.9728507 0.9953704 0.9839817 0.5333333 0.5308642 0.5456790 0.9818122
Class: HSPCs 0.8846154 0.9920844 0.8846154 0.9920844 0.8846154 0.8846154 0.8846154 0.0641975 0.0567901 0.0641975 0.9383499
Class: Monoblasts 0.8148148 0.9894180 0.8461538 0.9868074 0.8461538 0.8148148 0.8301887 0.0666667 0.0543210 0.0641975 0.9021164
Class: Monocytes 0.8947368 0.9948187 0.8947368 0.9948187 0.8947368 0.8947368 0.8947368 0.0469136 0.0419753 0.0469136 0.9447777
Class: Myeloblasts 0.9811321 0.9914773 0.9454545 0.9971429 0.9454545 0.9811321 0.9629630 0.1308642 0.1283951 0.1358025 0.9863047
Class: Myelocytes 0.8800000 0.9947368 0.9166667 0.9921260 0.9166667 0.8800000 0.8979592 0.0617284 0.0543210 0.0592593 0.9373684
Class: Neutrophils 0.8750000 0.9948586 0.8750000 0.9948586 0.8750000 0.8750000 0.8750000 0.0395062 0.0345679 0.0395062 0.9349293
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9974874 1.0000000 0.8750000 0.9333333 0.0197531 0.0172840 0.0172840 0.9375000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9925926 NA 0.0000000 NA 0.0074074 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.7500000 0.9949622 0.7500000 0.9949622 0.7500000 0.7500000 0.7500000 0.0197531 0.0148148 0.0197531 0.8724811
Class: T-NK 0.7500000 1.0000000 1.0000000 0.9975124 1.0000000 0.7500000 0.8571429 0.0098765 0.0074074 0.0074074 0.8750000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 215 3 0 0 0 0 0 1 0 2 0
HSPCs 1 23 1 0 0 0 0 0 0 0 1
Monoblasts 0 0 22 2 1 1 0 0 0 0 0
Monocytes 0 0 1 17 0 0 0 0 1 0 0
Myeloblasts 0 0 3 0 52 0 0 0 0 0 0
Myelocytes 0 0 0 0 0 22 2 0 0 0 0
Neutrophils 0 0 0 0 0 2 14 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 0 0 0 0 0 0 2 6 0
T-NK 0 0 0 0 0 0 0 0 0 0 3

M1M2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9147059 0.8754264 0.879801 0.9421335 0.5294118 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9944444 0.9750000 0.9781421 0.9936306 0.9781421 0.9944444 0.9862259 0.5294118 0.5264706 0.5382353 0.9847222
Class: HSPCs 0.8000000 0.9723077 0.5714286 0.9905956 0.5714286 0.8000000 0.6666667 0.0441176 0.0352941 0.0617647 0.8861538
Class: Monoblasts 0.7222222 0.9813665 0.6842105 0.9844237 0.6842105 0.7222222 0.7027027 0.0529412 0.0382353 0.0558824 0.8517943
Class: Monocytes 0.8000000 0.9938462 0.8571429 0.9907975 0.8571429 0.8000000 0.8275862 0.0441176 0.0352941 0.0411765 0.8969231
Class: Myeloblasts 0.9743590 0.9933555 0.9500000 0.9966667 0.9500000 0.9743590 0.9620253 0.1147059 0.1117647 0.1176471 0.9838572
Class: Myelocytes 0.9333333 0.9907692 0.8235294 0.9969040 0.8235294 0.9333333 0.8750000 0.0441176 0.0411765 0.0500000 0.9620513
Class: Neutrophils 0.8695652 1.0000000 1.0000000 0.9906250 1.0000000 0.8695652 0.9302326 0.0676471 0.0588235 0.0588235 0.9347826
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9969970 1.0000000 0.8750000 0.9333333 0.0235294 0.0205882 0.0205882 0.9375000
Class: Pre-B 0.1666667 1.0000000 1.0000000 0.9852507 1.0000000 0.1666667 0.2857143 0.0176471 0.0029412 0.0029412 0.5833333
Class: Pro-B 0.8823529 0.9907121 0.8333333 0.9937888 0.8333333 0.8823529 0.8571429 0.0500000 0.0441176 0.0529412 0.9365325
Class: T-NK 0.0000000 1.0000000 NaN 0.9882353 NA 0.0000000 NA 0.0117647 0.0000000 0.0000000 0.5000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 179 2 0 0 0 1 0 1 0 0 0
HSPCs 1 12 2 0 0 0 0 0 1 1 4
Monoblasts 0 1 13 3 1 0 0 0 0 1 0
Monocytes 0 0 1 12 0 0 0 0 1 0 0
Myeloblasts 0 0 2 0 38 0 0 0 0 0 0
Myelocytes 0 0 0 0 0 14 3 0 0 0 0
Neutrophils 0 0 0 0 0 0 20 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 0 1 0 0
Pro-B 0 0 0 0 0 0 0 0 3 15 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

M1M3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9415584 0.9109912 0.9092077 0.9649997 0.5616883 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9925926 0.9942529 1.0000000 0.9942529 1.0000000 0.9971182 0.5616883 0.5616883 0.5649351 0.9962963
Class: HSPCs 0.8947368 0.9792388 0.7391304 0.9929825 0.7391304 0.8947368 0.8095238 0.0616883 0.0551948 0.0746753 0.9369878
Class: Monoblasts 0.5333333 0.9897611 0.7272727 0.9764310 0.7272727 0.5333333 0.6153846 0.0487013 0.0259740 0.0357143 0.7615472
Class: Monocytes 1.0000000 0.9932886 0.8333333 1.0000000 0.8333333 1.0000000 0.9090909 0.0324675 0.0324675 0.0389610 0.9966443
Class: Myeloblasts 0.9655172 0.9856631 0.8750000 0.9963768 0.8750000 0.9655172 0.9180328 0.0941558 0.0909091 0.1038961 0.9755902
Class: Myelocytes 0.9285714 0.9965986 0.9285714 0.9965986 0.9285714 0.9285714 0.9285714 0.0454545 0.0422078 0.0454545 0.9625850
Class: Neutrophils 0.9285714 1.0000000 1.0000000 0.9966102 1.0000000 0.9285714 0.9629630 0.0454545 0.0422078 0.0422078 0.9642857
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0194805 0.0194805 0.0194805 1.0000000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9870130 NA 0.0000000 NA 0.0129870 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.9500000 0.9965278 0.9500000 0.9965278 0.9500000 0.9500000 0.9500000 0.0649351 0.0616883 0.0649351 0.9732639
Class: T-NK 0.7500000 1.0000000 1.0000000 0.9967213 1.0000000 0.7500000 0.8571429 0.0129870 0.0097403 0.0097403 0.8750000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 173 0 1 0 0 0 0 0 0 0 0
HSPCs 0 17 1 0 1 0 0 0 2 1 1
Monoblasts 0 2 8 0 0 0 0 0 1 0 0
Monocytes 0 0 2 10 0 0 0 0 0 0 0
Myeloblasts 0 0 3 0 28 1 0 0 0 0 0
Myelocytes 0 0 0 0 0 13 1 0 0 0 0
Neutrophils 0 0 0 0 0 0 13 0 0 0 0
Pericytes 0 0 0 0 0 0 0 6 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 0 0 0 0 0 0 1 19 0
T-NK 0 0 0 0 0 0 0 0 0 0 3

M2M1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9407407 0.9120131 0.9131074 0.9616662 0.5333333 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9735450 0.9773756 1.0000000 0.9773756 1.0000000 0.9885584 0.5333333 0.5333333 0.5456790 0.9867725
Class: HSPCs 0.8461538 1.0000000 1.0000000 0.9895561 1.0000000 0.8461538 0.9166667 0.0641975 0.0543210 0.0543210 0.9230769
Class: Monoblasts 0.7037037 0.9920635 0.8636364 0.9791123 0.8636364 0.7037037 0.7755102 0.0666667 0.0469136 0.0543210 0.8478836
Class: Monocytes 0.8947368 0.9974093 0.9444444 0.9948320 0.9444444 0.8947368 0.9189189 0.0469136 0.0419753 0.0444444 0.9460731
Class: Myeloblasts 1.0000000 0.9687500 0.8281250 1.0000000 0.8281250 1.0000000 0.9059829 0.1308642 0.1308642 0.1580247 0.9843750
Class: Myelocytes 0.7600000 1.0000000 1.0000000 0.9844560 1.0000000 0.7600000 0.8636364 0.0617284 0.0469136 0.0469136 0.8800000
Class: Neutrophils 1.0000000 0.9922879 0.8421053 1.0000000 0.8421053 1.0000000 0.9142857 0.0395062 0.0395062 0.0469136 0.9961440
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9974874 1.0000000 0.8750000 0.9333333 0.0197531 0.0172840 0.0172840 0.9375000
Class: Pre-B 0.3333333 1.0000000 1.0000000 0.9950495 1.0000000 0.3333333 0.5000000 0.0074074 0.0024691 0.0024691 0.6666667
Class: Pro-B 0.8750000 0.9974811 0.8750000 0.9974811 0.8750000 0.8750000 0.8750000 0.0197531 0.0172840 0.0197531 0.9362406
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0098765 0.0098765 0.0098765 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 216 3 0 0 0 0 0 1 0 1 0
HSPCs 0 22 0 0 0 0 0 0 0 0 0
Monoblasts 0 0 19 2 0 1 0 0 0 0 0
Monocytes 0 0 0 17 0 0 0 0 1 0 0
Myeloblasts 0 1 8 0 53 2 0 0 0 0 0
Myelocytes 0 0 0 0 0 19 0 0 0 0 0
Neutrophils 0 0 0 0 0 3 16 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 0 1 0 0
Pro-B 0 0 0 0 0 0 0 0 1 7 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

M2M2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9470588 0.9224374 0.9176186 0.9683255 0.5294118 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9750000 0.9782609 1.0000000 0.9782609 1.0000000 0.9890110 0.5294118 0.5294118 0.5411765 0.9875000
Class: HSPCs 0.7333333 0.9969231 0.9166667 0.9878049 0.9166667 0.7333333 0.8148148 0.0441176 0.0323529 0.0352941 0.8651282
Class: Monoblasts 0.6666667 1.0000000 1.0000000 0.9817073 1.0000000 0.6666667 0.8000000 0.0529412 0.0352941 0.0352941 0.8333333
Class: Monocytes 1.0000000 0.9969231 0.9375000 1.0000000 0.9375000 1.0000000 0.9677419 0.0441176 0.0441176 0.0470588 0.9984615
Class: Myeloblasts 1.0000000 0.9767442 0.8478261 1.0000000 0.8478261 1.0000000 0.9176471 0.1147059 0.1147059 0.1352941 0.9883721
Class: Myelocytes 0.7333333 0.9969231 0.9166667 0.9878049 0.9166667 0.7333333 0.8148148 0.0441176 0.0323529 0.0352941 0.8651282
Class: Neutrophils 0.9565217 0.9905363 0.8800000 0.9968254 0.8800000 0.9565217 0.9166667 0.0676471 0.0647059 0.0735294 0.9735290
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9969970 1.0000000 0.8750000 0.9333333 0.0235294 0.0205882 0.0205882 0.9375000
Class: Pre-B 0.8333333 1.0000000 1.0000000 0.9970149 1.0000000 0.8333333 0.9090909 0.0176471 0.0147059 0.0147059 0.9166667
Class: Pro-B 0.9411765 0.9969040 0.9411765 0.9969040 0.9411765 0.9411765 0.9411765 0.0500000 0.0470588 0.0500000 0.9690402
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0117647 0.0117647 0.0117647 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 180 2 0 0 0 1 0 1 0 0 0
HSPCs 0 11 1 0 0 0 0 0 0 0 0
Monoblasts 0 0 12 0 0 0 0 0 0 0 0
Monocytes 0 0 1 15 0 0 0 0 0 0 0
Myeloblasts 0 2 4 0 39 0 0 0 0 1 0
Myelocytes 0 0 0 0 0 11 1 0 0 0 0
Neutrophils 0 0 0 0 0 3 22 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 0 5 0 0
Pro-B 0 0 0 0 0 0 0 0 1 16 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

M2M3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9415584 0.9105013 0.9092077 0.9649997 0.5616883 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9777778 0.9829545 1.0000000 0.9829545 1.0000000 0.9914040 0.5616883 0.5616883 0.5714286 0.9888889
Class: HSPCs 0.8947368 0.9896194 0.8500000 0.9930556 0.8500000 0.8947368 0.8717949 0.0616883 0.0551948 0.0649351 0.9421781
Class: Monoblasts 0.6000000 0.9897611 0.7500000 0.9797297 0.7500000 0.6000000 0.6666667 0.0487013 0.0292208 0.0389610 0.7948805
Class: Monocytes 0.7000000 0.9966443 0.8750000 0.9900000 0.8750000 0.7000000 0.7777778 0.0324675 0.0227273 0.0259740 0.8483221
Class: Myeloblasts 0.9655172 0.9749104 0.8000000 0.9963370 0.8000000 0.9655172 0.8750000 0.0941558 0.0909091 0.1136364 0.9702138
Class: Myelocytes 0.7142857 1.0000000 1.0000000 0.9865772 1.0000000 0.7142857 0.8333333 0.0454545 0.0324675 0.0324675 0.8571429
Class: Neutrophils 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0454545 0.0454545 0.0454545 1.0000000
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0194805 0.0194805 0.0194805 1.0000000
Class: Pre-B 0.5000000 1.0000000 1.0000000 0.9934641 1.0000000 0.5000000 0.6666667 0.0129870 0.0064935 0.0064935 0.7500000
Class: Pro-B 1.0000000 0.9965278 0.9523810 1.0000000 0.9523810 1.0000000 0.9756098 0.0649351 0.0649351 0.0681818 0.9982639
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0129870 0.0129870 0.0129870 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 173 1 1 0 1 0 0 0 0 0 0
HSPCs 0 17 1 0 0 0 0 0 2 0 0
Monoblasts 0 0 9 3 0 0 0 0 0 0 0
Monocytes 0 0 1 7 0 0 0 0 0 0 0
Myeloblasts 0 0 3 0 28 4 0 0 0 0 0
Myelocytes 0 0 0 0 0 10 0 0 0 0 0
Neutrophils 0 0 0 0 0 0 14 0 0 0 0
Pericytes 0 0 0 0 0 0 0 6 0 0 0
Pre-B 0 0 0 0 0 0 0 0 2 0 0
Pro-B 0 1 0 0 0 0 0 0 0 20 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

M3M1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9259259 0.8897969 0.8959416 0.9494672 0.5333333 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9629630 0.9686099 1.0000000 0.9686099 1.0000000 0.9840547 0.5333333 0.5333333 0.5506173 0.9814815
Class: HSPCs 0.8461538 0.9947230 0.9166667 0.9895013 0.9166667 0.8461538 0.8800000 0.0641975 0.0543210 0.0592593 0.9204384
Class: Monoblasts 0.7407407 0.9841270 0.7692308 0.9815303 0.7692308 0.7407407 0.7547170 0.0666667 0.0493827 0.0641975 0.8624339
Class: Monocytes 0.7368421 0.9948187 0.8750000 0.9871465 0.8750000 0.7368421 0.8000000 0.0469136 0.0345679 0.0395062 0.8658304
Class: Myeloblasts 0.9622642 0.9886364 0.9272727 0.9942857 0.9272727 0.9622642 0.9444444 0.1308642 0.1259259 0.1358025 0.9754503
Class: Myelocytes 0.9200000 0.9842105 0.7931034 0.9946809 0.7931034 0.9200000 0.8518519 0.0617284 0.0567901 0.0716049 0.9521053
Class: Neutrophils 0.6875000 0.9974293 0.9166667 0.9872774 0.9166667 0.6875000 0.7857143 0.0395062 0.0271605 0.0296296 0.8424647
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9974874 1.0000000 0.8750000 0.9333333 0.0197531 0.0172840 0.0172840 0.9375000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9925926 NA 0.0000000 NA 0.0074074 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.8750000 0.9949622 0.7777778 0.9974747 0.7777778 0.8750000 0.8235294 0.0197531 0.0172840 0.0222222 0.9349811
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0098765 0.0098765 0.0098765 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 216 3 0 0 1 1 0 1 0 1 0
HSPCs 0 22 2 0 0 0 0 0 0 0 0
Monoblasts 0 0 20 5 0 0 0 0 1 0 0
Monocytes 0 0 2 14 0 0 0 0 0 0 0
Myeloblasts 0 1 3 0 51 0 0 0 0 0 0
Myelocytes 0 0 0 0 1 23 5 0 0 0 0
Neutrophils 0 0 0 0 0 1 11 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 0 0 0 0 0 0 2 7 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

M3M2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9117647 0.8706437 0.8764358 0.9396758 0.5294118 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9888889 0.9562500 0.9621622 0.9870968 0.9621622 0.9888889 0.9753425 0.5294118 0.5235294 0.5441176 0.9725694
Class: HSPCs 0.8000000 0.9784615 0.6315789 0.9906542 0.6315789 0.8000000 0.7058824 0.0441176 0.0352941 0.0558824 0.8892308
Class: Monoblasts 0.7222222 0.9844720 0.7222222 0.9844720 0.7222222 0.7222222 0.7222222 0.0529412 0.0382353 0.0529412 0.8533471
Class: Monocytes 0.6666667 0.9969231 0.9090909 0.9848024 0.9090909 0.6666667 0.7692308 0.0441176 0.0294118 0.0323529 0.8317949
Class: Myeloblasts 0.9487179 0.9900332 0.9250000 0.9933333 0.9250000 0.9487179 0.9367089 0.1147059 0.1088235 0.1176471 0.9693756
Class: Myelocytes 0.8666667 0.9907692 0.8125000 0.9938272 0.8125000 0.8666667 0.8387097 0.0441176 0.0382353 0.0470588 0.9287179
Class: Neutrophils 0.8260870 0.9968454 0.9500000 0.9875000 0.9500000 0.8260870 0.8837209 0.0676471 0.0558824 0.0588235 0.9114662
Class: Pericytes 0.7500000 1.0000000 1.0000000 0.9940120 1.0000000 0.7500000 0.8571429 0.0235294 0.0176471 0.0176471 0.8750000
Class: Pre-B 0.5000000 1.0000000 1.0000000 0.9910979 1.0000000 0.5000000 0.6666667 0.0176471 0.0088235 0.0088235 0.7500000
Class: Pro-B 1.0000000 0.9907121 0.8500000 1.0000000 0.8500000 1.0000000 0.9189189 0.0500000 0.0500000 0.0588235 0.9953560
Class: T-NK 0.5000000 1.0000000 1.0000000 0.9940828 1.0000000 0.5000000 0.6666667 0.0117647 0.0058824 0.0058824 0.7500000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 178 2 0 0 2 1 1 1 0 0 0
HSPCs 2 12 2 0 0 0 0 1 0 0 2
Monoblasts 0 0 13 5 0 0 0 0 0 0 0
Monocytes 0 0 1 10 0 0 0 0 0 0 0
Myeloblasts 0 1 2 0 37 0 0 0 0 0 0
Myelocytes 0 0 0 0 0 13 3 0 0 0 0
Neutrophils 0 0 0 0 0 1 19 0 0 0 0
Pericytes 0 0 0 0 0 0 0 6 0 0 0
Pre-B 0 0 0 0 0 0 0 0 3 0 0
Pro-B 0 0 0 0 0 0 0 0 3 17 0
T-NK 0 0 0 0 0 0 0 0 0 0 2

M3M3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9512987 0.9254514 0.9209459 0.9724895 0.5616883 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9777778 0.9829545 1.0000000 0.9829545 1.0000000 0.9914040 0.5616883 0.5616883 0.5714286 0.9888889
Class: HSPCs 0.9473684 0.9896194 0.8571429 0.9965157 0.8571429 0.9473684 0.9000000 0.0616883 0.0584416 0.0681818 0.9684939
Class: Monoblasts 0.6000000 0.9897611 0.7500000 0.9797297 0.7500000 0.6000000 0.6666667 0.0487013 0.0292208 0.0389610 0.7948805
Class: Monocytes 0.7000000 1.0000000 1.0000000 0.9900332 1.0000000 0.7000000 0.8235294 0.0324675 0.0227273 0.0227273 0.8500000
Class: Myeloblasts 0.9655172 0.9928315 0.9333333 0.9964029 0.9333333 0.9655172 0.9491525 0.0941558 0.0909091 0.0974026 0.9791744
Class: Myelocytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0454545 0.0454545 0.0454545 1.0000000
Class: Neutrophils 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0454545 0.0454545 0.0454545 1.0000000
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0194805 0.0194805 0.0194805 1.0000000
Class: Pre-B 0.2500000 1.0000000 1.0000000 0.9902280 1.0000000 0.2500000 0.4000000 0.0129870 0.0032468 0.0032468 0.6250000
Class: Pro-B 1.0000000 0.9861111 0.8333333 1.0000000 0.8333333 1.0000000 0.9090909 0.0649351 0.0649351 0.0779221 0.9930556
Class: T-NK 0.7500000 1.0000000 1.0000000 0.9967213 1.0000000 0.7500000 0.8571429 0.0129870 0.0097403 0.0097403 0.8750000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 173 0 2 0 1 0 0 0 0 0 0
HSPCs 0 18 2 0 0 0 0 0 1 0 0
Monoblasts 0 0 9 3 0 0 0 0 0 0 0
Monocytes 0 0 0 7 0 0 0 0 0 0 0
Myeloblasts 0 0 2 0 28 0 0 0 0 0 0
Myelocytes 0 0 0 0 0 14 0 0 0 0 0
Neutrophils 0 0 0 0 0 0 14 0 0 0 0
Pericytes 0 0 0 0 0 0 0 6 0 0 0
Pre-B 0 0 0 0 0 0 0 0 1 0 0
Pro-B 0 1 0 0 0 0 0 0 2 20 1
T-NK 0 0 0 0 0 0 0 0 0 0 3

M1H1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6552668 0.5906 0.6195556 0.6897188 0.2694938 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.7758621 0.9212481 0.4591837 0.9794629 0.4591837 0.7758621 0.5769231 0.0793434 0.0615595 0.1340629 0.8485551
Class: Erythroblasts 0.9593909 0.9138577 0.8042553 0.9838710 0.8042553 0.9593909 0.8750000 0.2694938 0.2585499 0.3214774 0.9366243
Class: Neutrophils 0.9206349 0.9356287 0.5742574 0.9920635 0.5742574 0.9206349 0.7073171 0.0861833 0.0793434 0.1381669 0.9281318
Class: Monoblasts 0.4000000 0.9664804 0.2000000 0.9871612 0.2000000 0.4000000 0.2666667 0.0205198 0.0082079 0.0410397 0.6832402
Class: Pro-B 0.3333333 0.9970972 0.8750000 0.9608392 0.8750000 0.3333333 0.4827586 0.0574555 0.0191518 0.0218878 0.6652153
Class: HSPCs 0.5000000 0.9270386 0.2388060 0.9759036 0.2388060 0.5000000 0.3232323 0.0437756 0.0218878 0.0916553 0.7135193
Class: Pericytes 0.3333333 1.0000000 1.0000000 0.9972603 1.0000000 0.3333333 0.5000000 0.0041040 0.0013680 0.0013680 0.6666667
Class: Myelocytes 0.5142857 0.9928058 0.9574468 0.8665620 0.9574468 0.5142857 0.6691450 0.2393981 0.1231190 0.1285910 0.7535457
Class: Monocytes 0.8055556 0.9559939 0.6666667 0.9782609 0.6666667 0.8055556 0.7295597 0.0984952 0.0793434 0.1190150 0.8807747
Class: Pre-B 0.0000000 1.0000000 NaN 0.9534884 NA 0.0000000 NA 0.0465116 0.0000000 0.0000000 0.5000000
Class: T-NK 0.0500000 1.0000000 1.0000000 0.9478738 1.0000000 0.0500000 0.0952381 0.0547196 0.0027360 0.0027360 0.5250000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 45 1 0 5 0 1 0 40 3 2 1
Erythroblasts 4 189 0 1 4 11 2 5 2 12 5
Neutrophils 0 0 58 0 0 0 0 39 2 1 1
Monoblasts 4 0 0 6 4 2 0 1 4 7 2
Pro-B 0 0 0 0 14 1 0 0 0 1 0
HSPCs 5 5 0 2 14 16 0 0 3 7 15
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 1 2 0 1 0 0 90 0 0 0
Monocytes 0 1 3 1 5 1 0 0 58 4 14
Pre-B 0 0 0 0 0 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 2

M1H2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6920052 0.5754889 0.6578959 0.7246225 0.4508519 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.7244898 0.9624060 0.7395833 0.9595202 0.7395833 0.7244898 0.7319588 0.1284404 0.0930537 0.1258191 0.8434479
Class: Erythroblasts 0.9883721 0.8353222 0.8312958 0.9887006 0.8312958 0.9883721 0.9030544 0.4508519 0.4456094 0.5360419 0.9118471
Class: Neutrophils 0.6666667 0.9907162 0.4615385 0.9960000 0.4615385 0.6666667 0.5454545 0.0117955 0.0078637 0.0170380 0.8286914
Class: Monoblasts 0.4242424 0.9438356 0.2545455 0.9731638 0.2545455 0.4242424 0.3181818 0.0432503 0.0183486 0.0720839 0.6840390
Class: Pro-B 0.4444444 0.9986577 0.8888889 0.9867374 0.8888889 0.4444444 0.5925926 0.0235911 0.0104849 0.0117955 0.7215511
Class: HSPCs 0.5652174 0.9243243 0.1884058 0.9855908 0.1884058 0.5652174 0.2826087 0.0301442 0.0170380 0.0904325 0.7447709
Class: Pericytes 0.7500000 1.0000000 1.0000000 0.9973580 1.0000000 0.7500000 0.8571429 0.0104849 0.0078637 0.0078637 0.8750000
Class: Myelocytes 0.3571429 0.9959184 0.7692308 0.9760000 0.7692308 0.3571429 0.4878049 0.0366972 0.0131062 0.0170380 0.6765306
Class: Monocytes 0.9333333 0.9530583 0.6292135 0.9940653 0.6292135 0.9333333 0.7516779 0.0786370 0.0733945 0.1166448 0.9431958
Class: Pre-B 0.0000000 1.0000000 NaN 0.8964613 NA 0.0000000 NA 0.1035387 0.0000000 0.0000000 0.5000000
Class: T-NK 0.0634921 1.0000000 1.0000000 0.9222661 1.0000000 0.0634921 0.1194030 0.0825688 0.0052425 0.0052425 0.5317460
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 71 1 0 8 0 3 0 9 0 2 2
Erythroblasts 1 340 0 2 1 7 1 4 0 47 6
Neutrophils 0 0 6 0 0 0 0 4 1 1 1
Monoblasts 21 1 0 14 3 0 0 1 2 5 8
Pro-B 0 0 0 0 8 0 0 0 0 1 0
HSPCs 5 1 0 8 4 13 1 0 1 10 26
Pericytes 0 0 0 0 0 0 6 0 0 0 0
Myelocytes 0 0 3 0 0 0 0 10 0 0 0
Monocytes 0 1 0 1 2 0 0 0 56 13 16
Pre-B 0 0 0 0 0 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

M1H3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.7176166 0.6411507 0.6698595 0.7620001 0.3419689 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.7750000 0.9444444 0.7848101 0.9413681 0.7848101 0.7750000 0.7798742 0.2072539 0.1606218 0.2046632 0.8597222
Class: Erythroblasts 1.0000000 0.9133858 0.8571429 1.0000000 0.8571429 1.0000000 0.9230769 0.3419689 0.3419689 0.3989637 0.9566929
Class: Neutrophils 0.8636364 0.9505495 0.5135135 0.9914040 0.5135135 0.8636364 0.6440678 0.0569948 0.0492228 0.0958549 0.9070929
Class: Monoblasts 0.4400000 0.9556787 0.4074074 0.9610028 0.4074074 0.4400000 0.4230769 0.0647668 0.0284974 0.0699482 0.6978393
Class: Pro-B 0.0000000 0.9973753 0.0000000 0.9870130 0.0000000 0.0000000 NaN 0.0129534 0.0000000 0.0025907 0.4986877
Class: HSPCs 0.5000000 0.9497354 0.1739130 0.9889807 0.1739130 0.5000000 0.2580645 0.0207254 0.0103627 0.0595855 0.7248677
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0025907 0.0025907 0.0025907 1.0000000
Class: Myelocytes 0.4337349 0.9966997 0.9729730 0.8653295 0.9729730 0.4337349 0.6000000 0.2150259 0.0932642 0.0958549 0.7152173
Class: Monocytes 0.9230769 0.9597855 0.4444444 0.9972145 0.4444444 0.9230769 0.6000000 0.0336788 0.0310881 0.0699482 0.9414312
Class: Pre-B 0.0000000 1.0000000 NaN 0.9689119 NA 0.0000000 NA 0.0310881 0.0000000 0.0000000 0.5000000
Class: T-NK 0.0000000 1.0000000 NaN 0.9870466 NA 0.0000000 NA 0.0129534 0.0000000 0.0000000 0.5000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 62 0 0 3 0 0 0 13 1 0 0
Erythroblasts 3 132 0 0 4 2 0 9 0 3 1
Neutrophils 0 0 19 0 0 0 0 18 0 0 0
Monoblasts 10 0 0 11 0 1 0 3 0 1 1
Pro-B 0 0 0 0 0 0 0 0 0 1 0
HSPCs 5 0 0 4 1 4 0 3 0 3 3
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 0 1 0 0 0 0 36 0 0 0
Monocytes 0 0 2 7 0 1 0 1 12 4 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

M2H1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6443228 0.5832822 0.6084079 0.6790676 0.2694938 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9482759 0.8484398 0.3503185 0.9947735 0.3503185 0.9482759 0.5116279 0.0793434 0.0752394 0.2147743 0.8983578
Class: Erythroblasts 0.9492386 0.9494382 0.8738318 0.9806576 0.8738318 0.9492386 0.9099757 0.2694938 0.2558140 0.2927497 0.9493384
Class: Neutrophils 0.9682540 0.9116766 0.5083333 0.9967267 0.5083333 0.9682540 0.6666667 0.0861833 0.0834473 0.1641587 0.9399653
Class: Monoblasts 0.1333333 0.9874302 0.1818182 0.9819444 0.1818182 0.1333333 0.1538462 0.0205198 0.0027360 0.0150479 0.5603818
Class: Pro-B 0.5238095 0.9869376 0.7096774 0.9714286 0.7096774 0.5238095 0.6027397 0.0574555 0.0300958 0.0424077 0.7553736
Class: HSPCs 0.4062500 0.9785408 0.4642857 0.9729730 0.4642857 0.4062500 0.4333333 0.0437756 0.0177839 0.0383037 0.6923954
Class: Pericytes 0.3333333 1.0000000 1.0000000 0.9972603 1.0000000 0.3333333 0.5000000 0.0041040 0.0013680 0.0013680 0.6666667
Class: Myelocytes 0.3085714 0.9946043 0.9473684 0.8204748 0.9473684 0.3085714 0.4655172 0.2393981 0.0738714 0.0779754 0.6515879
Class: Monocytes 0.7916667 0.9590288 0.6785714 0.9768161 0.6785714 0.7916667 0.7307692 0.0984952 0.0779754 0.1149111 0.8753477
Class: Pre-B 0.0294118 0.9870875 0.1000000 0.9542302 0.1000000 0.0294118 0.0454545 0.0465116 0.0013680 0.0136799 0.5082496
Class: T-NK 0.4500000 1.0000000 1.0000000 0.9691445 1.0000000 0.4500000 0.6206897 0.0547196 0.0246238 0.0246238 0.7250000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 55 4 0 10 0 7 0 66 9 4 2
Erythroblasts 2 187 0 0 5 7 1 2 1 6 3
Neutrophils 0 0 61 0 1 2 0 52 3 0 1
Monoblasts 1 0 0 2 1 1 0 0 2 2 2
Pro-B 0 0 0 0 22 1 0 0 0 6 2
HSPCs 0 0 0 2 3 13 1 0 0 6 3
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 1 1 0 0 0 0 54 0 0 1
Monocytes 0 5 1 1 3 1 0 1 57 9 6
Pre-B 0 0 0 0 7 0 0 0 0 1 2
T-NK 0 0 0 0 0 0 0 0 0 0 18

M2H2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.7051114 0.5972453 0.6713519 0.7372765 0.4508519 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9795918 0.9203008 0.6442953 0.9967427 0.6442953 0.9795918 0.7773279 0.1284404 0.1258191 0.1952818 0.9499463
Class: Erythroblasts 0.9854651 0.8973747 0.8874346 0.9868766 0.8874346 0.9854651 0.9338843 0.4508519 0.4442988 0.5006553 0.9414199
Class: Neutrophils 0.7777778 0.9854111 0.3888889 0.9973154 0.3888889 0.7777778 0.5185185 0.0117955 0.0091743 0.0235911 0.8815945
Class: Monoblasts 0.0909091 0.9589041 0.0909091 0.9589041 0.0909091 0.0909091 0.0909091 0.0432503 0.0039318 0.0432503 0.5249066
Class: Pro-B 0.3333333 0.9865772 0.3750000 0.9839357 0.3750000 0.3333333 0.3529412 0.0235911 0.0078637 0.0209699 0.6599553
Class: HSPCs 0.3043478 0.9675676 0.2258065 0.9781421 0.2258065 0.3043478 0.2592593 0.0301442 0.0091743 0.0406291 0.6359577
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9986772 1.0000000 0.8750000 0.9333333 0.0104849 0.0091743 0.0091743 0.9375000
Class: Myelocytes 0.2500000 0.9986395 0.8750000 0.9721854 0.8750000 0.2500000 0.3888889 0.0366972 0.0091743 0.0104849 0.6243197
Class: Monocytes 0.8166667 0.9359886 0.5212766 0.9835575 0.5212766 0.8166667 0.6363636 0.0786370 0.0642202 0.1231979 0.8763276
Class: Pre-B 0.0253165 0.9883041 0.2000000 0.8977424 0.2000000 0.0253165 0.0449438 0.1035387 0.0026212 0.0131062 0.5068103
Class: T-NK 0.2380952 1.0000000 1.0000000 0.9358289 1.0000000 0.2380952 0.3846154 0.0825688 0.0196592 0.0196592 0.6190476
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 96 2 1 20 0 5 0 12 3 4 6
Erythroblasts 1 339 0 1 0 9 0 3 0 26 3
Neutrophils 0 2 7 0 0 0 0 6 0 1 2
Monoblasts 1 1 0 3 1 1 0 0 7 11 8
Pro-B 0 0 0 0 6 0 0 0 0 7 3
HSPCs 0 0 0 4 0 7 0 0 1 4 15
Pericytes 0 0 0 0 0 0 7 0 0 0 0
Myelocytes 0 0 1 0 0 0 0 7 0 0 0
Monocytes 0 0 0 5 3 1 1 0 49 24 11
Pre-B 0 0 0 0 8 0 0 0 0 2 0
T-NK 0 0 0 0 0 0 0 0 0 0 15

M2H3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.7098446 0.6280734 0.6617841 0.7546529 0.3419689 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9250000 0.8692810 0.6491228 0.9779412 0.6491228 0.9250000 0.7628866 0.2072539 0.1917098 0.2953368 0.8971405
Class: Erythroblasts 0.9924242 0.9291339 0.8791946 0.9957806 0.8791946 0.9924242 0.9323843 0.3419689 0.3393782 0.3860104 0.9607791
Class: Neutrophils 1.0000000 0.9450549 0.5238095 1.0000000 0.5238095 1.0000000 0.6875000 0.0569948 0.0569948 0.1088083 0.9725275
Class: Monoblasts 0.2400000 0.9695291 0.3529412 0.9485095 0.3529412 0.2400000 0.2857143 0.0647668 0.0155440 0.0440415 0.6047645
Class: Pro-B 0.4000000 0.9973753 0.6666667 0.9921671 0.6666667 0.4000000 0.5000000 0.0129534 0.0051813 0.0077720 0.6986877
Class: HSPCs 0.3750000 0.9735450 0.2307692 0.9865952 0.2307692 0.3750000 0.2857143 0.0207254 0.0077720 0.0336788 0.6742725
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0025907 0.0025907 0.0025907 1.0000000
Class: Myelocytes 0.3253012 1.0000000 1.0000000 0.8440111 1.0000000 0.3253012 0.4909091 0.2150259 0.0699482 0.0699482 0.6626506
Class: Monocytes 0.6153846 0.9678284 0.4000000 0.9863388 0.4000000 0.6153846 0.4848485 0.0336788 0.0207254 0.0518135 0.7916065
Class: Pre-B 0.0000000 1.0000000 NaN 0.9689119 NA 0.0000000 NA 0.0310881 0.0000000 0.0000000 0.5000000
Class: T-NK 0.0000000 1.0000000 NaN 0.9870466 NA 0.0000000 NA 0.0129534 0.0000000 0.0000000 0.5000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 74 0 0 9 1 2 0 27 1 0 0
Erythroblasts 2 131 0 1 2 2 0 8 0 3 0
Neutrophils 0 0 22 0 0 0 0 20 0 0 0
Monoblasts 3 0 0 6 0 1 0 1 3 2 1
Pro-B 0 0 0 0 2 0 0 0 0 1 0
HSPCs 1 0 0 2 0 3 0 0 1 4 2
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 0 0 0 0 0 0 27 0 0 0
Monocytes 0 1 0 7 0 0 0 0 8 2 2
Pre-B 0 0 0 0 0 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

M3H1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.626539 0.559269 0.5903348 0.6617176 0.2694938 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.7413793 0.9361070 0.5000000 0.9767442 0.5000000 0.7413793 0.5972222 0.0793434 0.0588235 0.1176471 0.8387431
Class: Erythroblasts 0.9543147 0.9082397 0.7932489 0.9817814 0.7932489 0.9543147 0.8663594 0.2694938 0.2571819 0.3242134 0.9312772
Class: Neutrophils 0.9365079 0.9161677 0.5130435 0.9935065 0.5130435 0.9365079 0.6629213 0.0861833 0.0807114 0.1573187 0.9263378
Class: Monoblasts 0.1333333 0.9497207 0.0526316 0.9812410 0.0526316 0.1333333 0.0754717 0.0205198 0.0027360 0.0519836 0.5415270
Class: Pro-B 0.7380952 0.9811321 0.7045455 0.9839884 0.7045455 0.7380952 0.7209302 0.0574555 0.0424077 0.0601915 0.8596137
Class: HSPCs 0.5625000 0.9155937 0.2337662 0.9785933 0.2337662 0.5625000 0.3302752 0.0437756 0.0246238 0.1053352 0.7390469
Class: Pericytes 0.3333333 1.0000000 1.0000000 0.9972603 1.0000000 0.3333333 0.5000000 0.0041040 0.0013680 0.0013680 0.6666667
Class: Myelocytes 0.4457143 0.9928058 0.9512195 0.8505393 0.9512195 0.4457143 0.6070039 0.2393981 0.1067031 0.1121751 0.7192600
Class: Monocytes 0.4444444 0.9833080 0.7441860 0.9418605 0.7441860 0.4444444 0.5565217 0.0984952 0.0437756 0.0588235 0.7138762
Class: Pre-B 0.0000000 0.9971306 0.0000000 0.9533608 0.0000000 0.0000000 NaN 0.0465116 0.0000000 0.0027360 0.4985653
Class: T-NK 0.1500000 1.0000000 1.0000000 0.9531034 1.0000000 0.1500000 0.2608696 0.0547196 0.0082079 0.0082079 0.5750000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 43 1 0 6 0 0 0 31 4 0 1
Erythroblasts 5 188 0 0 4 12 1 8 4 8 7
Neutrophils 0 1 59 0 0 0 0 52 2 0 1
Monoblasts 4 1 0 2 3 1 0 2 20 3 2
Pro-B 0 0 0 0 31 1 0 0 0 8 4
HSPCs 6 4 0 7 1 18 1 4 10 13 13
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 1 3 0 0 0 0 78 0 0 0
Monocytes 0 1 1 0 1 0 0 0 32 2 6
Pre-B 0 0 0 0 2 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 6

M3H2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6854522 0.5708239 0.6511795 0.7182839 0.4508519 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.8673469 0.9518797 0.7264957 0.9798762 0.7264957 0.8673469 0.7906977 0.1284404 0.1114024 0.1533421 0.9096133
Class: Erythroblasts 0.9912791 0.8711217 0.8632911 0.9918478 0.8632911 0.9912791 0.9228687 0.4508519 0.4469201 0.5176933 0.9312004
Class: Neutrophils 0.7777778 0.9920424 0.5384615 0.9973333 0.5384615 0.7777778 0.6363636 0.0117955 0.0091743 0.0170380 0.8849101
Class: Monoblasts 0.2121212 0.9506849 0.1627907 0.9638889 0.1627907 0.2121212 0.1842105 0.0432503 0.0091743 0.0563565 0.5814031
Class: Pro-B 0.5555556 0.9825503 0.4347826 0.9891892 0.4347826 0.5555556 0.4878049 0.0235911 0.0131062 0.0301442 0.7690529
Class: HSPCs 0.4347826 0.8837838 0.1041667 0.9805097 0.1041667 0.4347826 0.1680672 0.0301442 0.0131062 0.1258191 0.6592832
Class: Pericytes 0.7500000 1.0000000 1.0000000 0.9973580 1.0000000 0.7500000 0.8571429 0.0104849 0.0078637 0.0078637 0.8750000
Class: Myelocytes 0.3214286 0.9986395 0.9000000 0.9747676 0.9000000 0.3214286 0.4736842 0.0366972 0.0117955 0.0131062 0.6600340
Class: Monocytes 0.6833333 0.9857752 0.8039216 0.9733146 0.8039216 0.6833333 0.7387387 0.0786370 0.0537353 0.0668414 0.8345543
Class: Pre-B 0.0000000 0.9970760 0.0000000 0.8961892 0.0000000 0.0000000 NaN 0.1035387 0.0000000 0.0026212 0.4985380
Class: T-NK 0.1111111 1.0000000 1.0000000 0.9259259 1.0000000 0.1111111 0.2000000 0.0825688 0.0091743 0.0091743 0.5555556
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 85 2 1 11 0 4 0 8 1 2 3
Erythroblasts 5 341 0 4 1 4 2 4 1 26 7
Neutrophils 0 1 7 0 0 0 0 5 0 0 0
Monoblasts 3 0 0 7 2 5 0 1 13 5 7
Pro-B 0 0 0 0 10 0 0 0 0 11 2
HSPCs 5 0 0 11 2 10 0 1 4 30 33
Pericytes 0 0 0 0 0 0 6 0 0 0 0
Myelocytes 0 0 1 0 0 0 0 9 0 0 0
Monocytes 0 0 0 0 1 0 0 0 41 5 4
Pre-B 0 0 0 0 2 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 7

M3H3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6891192 0.6046432 0.6403265 0.7349829 0.3419689 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.7875000 0.9509804 0.8076923 0.9448052 0.8076923 0.7875000 0.7974684 0.2072539 0.1632124 0.2020725 0.8692402
Class: Erythroblasts 0.9924242 0.8897638 0.8238994 0.9955947 0.8238994 0.9924242 0.9003436 0.3419689 0.3393782 0.4119171 0.9410940
Class: Neutrophils 0.9090909 0.9505495 0.5263158 0.9942529 0.5263158 0.9090909 0.6666667 0.0569948 0.0518135 0.0984456 0.9298202
Class: Monoblasts 0.3200000 0.9750693 0.4705882 0.9539295 0.4705882 0.3200000 0.3809524 0.0647668 0.0207254 0.0440415 0.6475346
Class: Pro-B 0.2000000 0.9921260 0.2500000 0.9895288 0.2500000 0.2000000 0.2222222 0.0129534 0.0025907 0.0103627 0.5960630
Class: HSPCs 0.3750000 0.8968254 0.0714286 0.9854651 0.0714286 0.3750000 0.1200000 0.0207254 0.0077720 0.1088083 0.6359127
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0025907 0.0025907 0.0025907 1.0000000
Class: Myelocytes 0.3855422 0.9933993 0.9411765 0.8551136 0.9411765 0.3855422 0.5470085 0.2150259 0.0829016 0.0880829 0.6894708
Class: Monocytes 0.5384615 0.9865952 0.5833333 0.9839572 0.5833333 0.5384615 0.5600000 0.0336788 0.0181347 0.0310881 0.7625284
Class: Pre-B 0.0000000 0.9973262 0.0000000 0.9688312 0.0000000 0.0000000 NaN 0.0310881 0.0000000 0.0025907 0.4986631
Class: T-NK 0.0000000 1.0000000 NaN 0.9870466 NA 0.0000000 NA 0.0129534 0.0000000 0.0000000 0.5000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 63 0 0 3 0 0 0 12 0 0 0
Erythroblasts 5 131 0 0 3 2 0 15 0 2 1
Neutrophils 0 0 20 0 0 0 0 18 0 0 0
Monoblasts 3 1 0 8 0 3 0 0 1 0 1
Pro-B 0 0 0 0 1 0 0 1 0 1 1
HSPCs 8 0 0 10 1 3 0 5 4 9 2
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 0 2 0 0 0 0 32 0 0 0
Monocytes 1 0 0 4 0 0 0 0 7 0 0
Pre-B 0 0 0 0 0 0 0 0 1 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

H1M1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.708642 0.5614993 0.66174 0.7524643 0.5333333 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.8941799 0.9152542 1.0000000 0.9152542 1.0000000 0.9557522 0.5333333 0.5333333 0.5827160 0.9470899
Class: HSPCs 0.4230769 0.9894459 0.7333333 0.9615385 0.7333333 0.4230769 0.5365854 0.0641975 0.0271605 0.0370370 0.7062614
Class: Monoblasts 0.1481481 1.0000000 1.0000000 0.9426434 1.0000000 0.1481481 0.2580645 0.0666667 0.0098765 0.0098765 0.5740741
Class: Monocytes 0.9473684 0.9740933 0.6428571 0.9973475 0.6428571 0.9473684 0.7659574 0.0469136 0.0444444 0.0691358 0.9607308
Class: Myeloblasts 0.0754717 0.9857955 0.4444444 0.8762626 0.4444444 0.0754717 0.1290323 0.1308642 0.0098765 0.0222222 0.5306336
Class: Myelocytes 0.9200000 0.8026316 0.2346939 0.9934853 0.2346939 0.9200000 0.3739837 0.0617284 0.0567901 0.2419753 0.8613158
Class: Neutrophils 0.0625000 1.0000000 1.0000000 0.9628713 1.0000000 0.0625000 0.1176471 0.0395062 0.0024691 0.0024691 0.5312500
Class: Pericytes 0.1250000 1.0000000 1.0000000 0.9826733 1.0000000 0.1250000 0.2222222 0.0197531 0.0024691 0.0024691 0.5625000
Class: Pre-B 0.0000000 0.9975124 0.0000000 0.9925743 0.0000000 0.0000000 NaN 0.0074074 0.0000000 0.0024691 0.4987562
Class: Pro-B 0.6250000 0.9924433 0.6250000 0.9924433 0.6250000 0.6250000 0.6250000 0.0197531 0.0123457 0.0197531 0.8087217
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0098765 0.0098765 0.0098765 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 216 9 2 0 2 2 0 2 0 3 0
HSPCs 0 11 1 0 0 0 0 3 0 0 0
Monoblasts 0 0 4 0 0 0 0 0 0 0 0
Monocytes 0 1 8 18 0 0 0 1 0 0 0
Myeloblasts 0 3 2 0 4 0 0 0 0 0 0
Myelocytes 0 2 10 1 47 23 15 0 0 0 0
Neutrophils 0 0 0 0 0 0 1 0 0 0 0
Pericytes 0 0 0 0 0 0 0 1 0 0 0
Pre-B 0 0 0 0 0 0 0 1 0 0 0
Pro-B 0 0 0 0 0 0 0 0 3 5 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

H1M2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.7294118 0.6010357 0.6788515 0.7759251 0.5294118 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.9187500 0.9326425 1.0000000 0.9326425 1.0000000 0.9651475 0.5294118 0.5294118 0.5676471 0.9593750
Class: HSPCs 0.4000000 0.9876923 0.6000000 0.9727273 0.6000000 0.4000000 0.4800000 0.0441176 0.0176471 0.0294118 0.6938462
Class: Monoblasts 0.0555556 1.0000000 1.0000000 0.9498525 1.0000000 0.0555556 0.1052632 0.0529412 0.0029412 0.0029412 0.5277778
Class: Monocytes 0.9333333 0.9846154 0.7368421 0.9968847 0.7368421 0.9333333 0.8235294 0.0441176 0.0411765 0.0558824 0.9589744
Class: Myeloblasts 0.1025641 0.9833887 0.4444444 0.8942598 0.4444444 0.1025641 0.1666667 0.1147059 0.0117647 0.0264706 0.5429764
Class: Myelocytes 1.0000000 0.8215385 0.2054795 1.0000000 0.2054795 1.0000000 0.3409091 0.0441176 0.0441176 0.2147059 0.9107692
Class: Neutrophils 0.3043478 1.0000000 1.0000000 0.9519520 1.0000000 0.3043478 0.4666667 0.0676471 0.0205882 0.0205882 0.6521739
Class: Pericytes 0.3750000 1.0000000 1.0000000 0.9851632 1.0000000 0.3750000 0.5454545 0.0235294 0.0088235 0.0088235 0.6875000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9823529 NA 0.0000000 NA 0.0176471 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.8235294 0.9783282 0.6666667 0.9905956 0.6666667 0.8235294 0.7368421 0.0500000 0.0411765 0.0617647 0.9009288
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0117647 0.0117647 0.0117647 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 180 4 1 0 2 0 1 3 0 2 0
HSPCs 0 6 2 0 0 0 0 2 0 0 0
Monoblasts 0 0 1 0 0 0 0 0 0 0 0
Monocytes 0 0 5 14 0 0 0 0 0 0 0
Myeloblasts 0 4 0 0 4 0 0 0 0 1 0
Myelocytes 0 0 9 1 33 15 15 0 0 0 0
Neutrophils 0 0 0 0 0 0 7 0 0 0 0
Pericytes 0 0 0 0 0 0 0 3 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 1 0 0 0 0 0 0 6 14 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

H1M3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.762987 0.6259151 0.7114664 0.8093697 0.5616883 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9942197 0.8666667 0.9052632 0.9915254 0.9052632 0.9942197 0.9476584 0.5616883 0.5584416 0.6168831 0.9304432
Class: HSPCs 0.4736842 0.9965398 0.9000000 0.9664430 0.9000000 0.4736842 0.6206897 0.0616883 0.0292208 0.0324675 0.7351120
Class: Monoblasts 0.1333333 1.0000000 1.0000000 0.9575163 1.0000000 0.1333333 0.2352941 0.0487013 0.0064935 0.0064935 0.5666667
Class: Monocytes 0.8000000 0.9865772 0.6666667 0.9932432 0.6666667 0.8000000 0.7272727 0.0324675 0.0259740 0.0389610 0.8932886
Class: Myeloblasts 0.1034483 0.9749104 0.3000000 0.9127517 0.3000000 0.1034483 0.1538462 0.0941558 0.0097403 0.0324675 0.5391793
Class: Myelocytes 1.0000000 0.8775510 0.2800000 1.0000000 0.2800000 1.0000000 0.4375000 0.0454545 0.0454545 0.1623377 0.9387755
Class: Neutrophils 0.4285714 0.9965986 0.8571429 0.9734219 0.8571429 0.4285714 0.5714286 0.0454545 0.0194805 0.0227273 0.7125850
Class: Pericytes 0.1666667 1.0000000 1.0000000 0.9837134 1.0000000 0.1666667 0.2857143 0.0194805 0.0032468 0.0032468 0.5833333
Class: Pre-B 0.0000000 1.0000000 NaN 0.9870130 NA 0.0000000 NA 0.0129870 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.8000000 0.9791667 0.7272727 0.9860140 0.7272727 0.8000000 0.7619048 0.0649351 0.0519481 0.0714286 0.8895833
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0129870 0.0129870 0.0129870 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 172 8 3 0 1 0 0 2 0 4 0
HSPCs 0 9 0 0 0 0 0 1 0 0 0
Monoblasts 0 0 2 0 0 0 0 0 0 0 0
Monocytes 0 0 2 8 0 0 0 2 0 0 0
Myeloblasts 0 1 5 1 3 0 0 0 0 0 0
Myelocytes 1 0 2 0 25 14 8 0 0 0 0
Neutrophils 0 1 0 0 0 0 6 0 0 0 0
Pericytes 0 0 0 0 0 0 0 1 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 1 1 0 0 0 0 4 16 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

H2M1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.8148148 0.7173656 0.773494 0.8514619 0.5333333 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.8941799 0.9152542 1.0000000 0.9152542 1.0000000 0.9557522 0.5333333 0.5333333 0.5827160 0.9470899
Class: HSPCs 0.3461538 1.0000000 1.0000000 0.9570707 1.0000000 0.3461538 0.5142857 0.0641975 0.0222222 0.0222222 0.6730769
Class: Monoblasts 0.2222222 0.9973545 0.8571429 0.9472362 0.8571429 0.2222222 0.3529412 0.0666667 0.0148148 0.0172840 0.6097884
Class: Monocytes 1.0000000 0.9637306 0.5757576 1.0000000 0.5757576 1.0000000 0.7307692 0.0469136 0.0469136 0.0814815 0.9818653
Class: Myeloblasts 0.9056604 0.9517045 0.7384615 0.9852941 0.7384615 0.9056604 0.8135593 0.1308642 0.1185185 0.1604938 0.9286825
Class: Myelocytes 0.8000000 0.9500000 0.5128205 0.9863388 0.5128205 0.8000000 0.6250000 0.0617284 0.0493827 0.0962963 0.8750000
Class: Neutrophils 0.0000000 1.0000000 NaN 0.9604938 NA 0.0000000 NA 0.0395062 0.0000000 0.0000000 0.5000000
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9974874 1.0000000 0.8750000 0.9333333 0.0197531 0.0172840 0.0172840 0.9375000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9925926 NA 0.0000000 NA 0.0074074 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.1250000 0.9924433 0.2500000 0.9825436 0.2500000 0.1250000 0.1666667 0.0197531 0.0024691 0.0098765 0.5587217
Class: T-NK 1.0000000 0.9975062 0.8000000 1.0000000 0.8000000 1.0000000 0.8888889 0.0098765 0.0098765 0.0123457 0.9987531
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 216 8 1 0 0 3 0 1 0 7 0
HSPCs 0 9 0 0 0 0 0 0 0 0 0
Monoblasts 0 1 6 0 0 0 0 0 0 0 0
Monocytes 0 1 10 19 0 1 2 0 0 0 0
Myeloblasts 0 6 10 0 48 1 0 0 0 0 0
Myelocytes 0 0 0 0 5 20 14 0 0 0 0
Neutrophils 0 0 0 0 0 0 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 0 0 0 0 0 0 3 1 0
T-NK 0 1 0 0 0 0 0 0 0 0 4

H2M2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.7617647 0.6402633 0.7128408 0.8060635 0.5294118 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9944444 0.8750000 0.8994975 0.9929078 0.8994975 0.9944444 0.9445910 0.5294118 0.5264706 0.5852941 0.9347222
Class: HSPCs 0.2666667 1.0000000 1.0000000 0.9672619 1.0000000 0.2666667 0.4210526 0.0441176 0.0117647 0.0117647 0.6333333
Class: Monoblasts 0.0000000 1.0000000 NaN 0.9470588 NA 0.0000000 NA 0.0529412 0.0000000 0.0000000 0.5000000
Class: Monocytes 1.0000000 0.9353846 0.4166667 1.0000000 0.4166667 1.0000000 0.5882353 0.0441176 0.0441176 0.1058824 0.9676923
Class: Myeloblasts 0.8974359 0.9501661 0.7000000 0.9862069 0.7000000 0.8974359 0.7865169 0.1147059 0.1029412 0.1470588 0.9238010
Class: Myelocytes 0.7333333 0.9476923 0.3928571 0.9871795 0.3928571 0.7333333 0.5116279 0.0441176 0.0323529 0.0823529 0.8405128
Class: Neutrophils 0.0000000 1.0000000 NaN 0.9323529 NA 0.0000000 NA 0.0676471 0.0000000 0.0000000 0.5000000
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9969970 1.0000000 0.8750000 0.9333333 0.0235294 0.0205882 0.0205882 0.9375000
Class: Pre-B 0.0000000 0.9940120 0.0000000 0.9822485 0.0000000 0.0000000 NaN 0.0176471 0.0000000 0.0058824 0.4970060
Class: Pro-B 0.2352941 0.9814241 0.4000000 0.9606061 0.4000000 0.2352941 0.2962963 0.0500000 0.0117647 0.0294118 0.6083591
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0117647 0.0117647 0.0117647 1.0000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 179 4 1 0 2 1 1 0 0 11 0
HSPCs 0 4 0 0 0 0 0 0 0 0 0
Monoblasts 0 0 0 0 0 0 0 0 0 0 0
Monocytes 0 0 10 15 1 3 7 0 0 0 0
Myeloblasts 1 7 7 0 35 0 0 0 0 0 0
Myelocytes 0 0 0 0 1 11 15 0 0 1 0
Neutrophils 0 0 0 0 0 0 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 7 0 0 0
Pre-B 0 0 0 0 0 0 0 1 0 1 0
Pro-B 0 0 0 0 0 0 0 0 6 4 0
T-NK 0 0 0 0 0 0 0 0 0 0 4

H2M3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.8019481 0.6867414 0.7529955 0.8449852 0.5616883 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.8814815 0.9153439 1.0000000 0.9153439 1.0000000 0.9558011 0.5616883 0.5616883 0.6136364 0.9407407
Class: HSPCs 0.4210526 0.9930796 0.8000000 0.9630872 0.8000000 0.4210526 0.5517241 0.0616883 0.0259740 0.0324675 0.7070661
Class: Monoblasts 0.0000000 1.0000000 NaN 0.9512987 NA 0.0000000 NA 0.0487013 0.0000000 0.0000000 0.5000000
Class: Monocytes 1.0000000 0.9530201 0.4166667 1.0000000 0.4166667 1.0000000 0.5882353 0.0324675 0.0324675 0.0779221 0.9765101
Class: Myeloblasts 0.8620690 0.9498208 0.6410256 0.9851301 0.6410256 0.8620690 0.7352941 0.0941558 0.0811688 0.1266234 0.9059449
Class: Myelocytes 0.8571429 0.9693878 0.5714286 0.9930314 0.5714286 0.8571429 0.6857143 0.0454545 0.0389610 0.0681818 0.9132653
Class: Neutrophils 0.0000000 1.0000000 NaN 0.9545455 NA 0.0000000 NA 0.0454545 0.0000000 0.0000000 0.5000000
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0194805 0.0194805 0.0194805 1.0000000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9870130 NA 0.0000000 NA 0.0129870 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.4500000 0.9826389 0.6428571 0.9625850 0.6428571 0.4500000 0.5294118 0.0649351 0.0292208 0.0454545 0.7163194
Class: T-NK 1.0000000 0.9967105 0.8000000 1.0000000 0.8000000 1.0000000 0.8888889 0.0129870 0.0129870 0.0162338 0.9983553
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 173 5 2 0 1 0 0 0 0 8 0
HSPCs 0 8 0 0 0 0 0 0 0 2 0
Monoblasts 0 0 0 0 0 0 0 0 0 0 0
Monocytes 0 1 4 10 0 1 8 0 0 0 0
Myeloblasts 0 5 8 0 25 1 0 0 0 0 0
Myelocytes 0 0 0 0 3 12 6 0 0 0 0
Neutrophils 0 0 0 0 0 0 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 6 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 1 0 0 0 0 0 4 9 0
T-NK 0 0 0 0 0 0 0 0 0 1 4

H3M1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6864198 0.5227956 0.6387578 0.7313321 0.5333333 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 1.0000000 0.8835979 0.9075630 1.0000000 0.9075630 1.0000000 0.9515419 0.5333333 0.5333333 0.5876543 0.9417989
Class: HSPCs 0.0000000 1.0000000 NaN 0.9358025 NA 0.0000000 NA 0.0641975 0.0000000 0.0000000 0.5000000
Class: Monoblasts 0.6666667 0.9444444 0.4615385 0.9754098 0.4615385 0.6666667 0.5454545 0.0666667 0.0444444 0.0962963 0.8055556
Class: Monocytes 0.2631579 0.9948187 0.7142857 0.9648241 0.7142857 0.2631579 0.3846154 0.0469136 0.0123457 0.0172840 0.6289883
Class: Myeloblasts 0.2452830 0.9715909 0.5652174 0.8952880 0.5652174 0.2452830 0.3421053 0.1308642 0.0320988 0.0567901 0.6084370
Class: Myelocytes 1.0000000 0.8105263 0.2577320 1.0000000 0.2577320 1.0000000 0.4098361 0.0617284 0.0617284 0.2395062 0.9052632
Class: Neutrophils 0.0000000 1.0000000 NaN 0.9604938 NA 0.0000000 NA 0.0395062 0.0000000 0.0000000 0.5000000
Class: Pericytes 0.0000000 1.0000000 NaN 0.9802469 NA 0.0000000 NA 0.0197531 0.0000000 0.0000000 0.5000000
Class: Pre-B 0.3333333 1.0000000 1.0000000 0.9950495 1.0000000 0.3333333 0.5000000 0.0074074 0.0024691 0.0024691 0.6666667
Class: Pro-B 0.0000000 1.0000000 NaN 0.9802469 NA 0.0000000 NA 0.0197531 0.0000000 0.0000000 0.5000000
Class: T-NK 0.0000000 1.0000000 NaN 0.9901235 NA 0.0000000 NA 0.0098765 0.0000000 0.0000000 0.5000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 216 10 1 0 0 0 0 5 0 5 1
HSPCs 0 0 0 0 0 0 0 0 0 0 0
Monoblasts 0 4 18 12 0 0 0 2 2 0 1
Monocytes 0 1 0 5 0 0 0 0 0 0 1
Myeloblasts 0 7 2 0 13 0 0 0 0 1 0
Myelocytes 0 4 6 2 40 25 16 1 0 2 1
Neutrophils 0 0 0 0 0 0 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 0 0 0 0
Pre-B 0 0 0 0 0 0 0 0 1 0 0
Pro-B 0 0 0 0 0 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

H3M2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6558824 0.4754954 0.6027237 0.706298 0.5294118 1.6e-06
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9944444 0.8312500 0.8689320 0.9925373 0.8689320 0.9944444 0.9274611 0.5294118 0.5264706 0.6058824 0.9128472
Class: HSPCs 0.0000000 1.0000000 NaN 0.9558824 NA 0.0000000 NA 0.0441176 0.0000000 0.0000000 0.5000000
Class: Monoblasts 0.6666667 0.9596273 0.4800000 0.9809524 0.4800000 0.6666667 0.5581395 0.0529412 0.0352941 0.0735294 0.8131470
Class: Monocytes 0.4666667 1.0000000 1.0000000 0.9759760 1.0000000 0.4666667 0.6363636 0.0441176 0.0205882 0.0205882 0.7333333
Class: Myeloblasts 0.2051282 0.9468439 0.3333333 0.9018987 0.3333333 0.2051282 0.2539683 0.1147059 0.0235294 0.0705882 0.5759860
Class: Myelocytes 1.0000000 0.8123077 0.1973684 1.0000000 0.1973684 1.0000000 0.3296703 0.0441176 0.0441176 0.2235294 0.9061538
Class: Neutrophils 0.0869565 1.0000000 1.0000000 0.9378698 1.0000000 0.0869565 0.1600000 0.0676471 0.0058824 0.0058824 0.5434783
Class: Pericytes 0.0000000 1.0000000 NaN 0.9764706 NA 0.0000000 NA 0.0235294 0.0000000 0.0000000 0.5000000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9823529 NA 0.0000000 NA 0.0176471 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.0000000 1.0000000 NaN 0.9500000 NA 0.0000000 NA 0.0500000 0.0000000 0.0000000 0.5000000
Class: T-NK 0.0000000 1.0000000 NaN 0.9882353 NA 0.0000000 NA 0.0117647 0.0000000 0.0000000 0.5000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 179 3 1 0 1 0 0 7 2 10 3
HSPCs 0 0 0 0 0 0 0 0 0 0 0
Monoblasts 0 2 12 7 0 0 0 1 2 1 0
Monocytes 0 0 0 7 0 0 0 0 0 0 0
Myeloblasts 1 9 4 0 8 0 0 0 0 2 0
Myelocytes 0 1 1 1 30 15 21 0 2 4 1
Neutrophils 0 0 0 0 0 0 2 0 0 0 0
Pericytes 0 0 0 0 0 0 0 0 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 0 0 0 0 0 0 0 0 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

H3M3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.6753247 0.4744207 0.6199058 0.7273313 0.5616883 2.98e-05
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Erythroblasts 0.9942197 0.8000000 0.8643216 0.9908257 0.8643216 0.9942197 0.9247312 0.5616883 0.5584416 0.6461039 0.8971098
Class: HSPCs 0.0000000 0.9896194 0.0000000 0.9377049 0.0000000 0.0000000 NaN 0.0616883 0.0000000 0.0097403 0.4948097
Class: Monoblasts 0.4666667 0.9590444 0.3684211 0.9723183 0.3684211 0.4666667 0.4117647 0.0487013 0.0227273 0.0616883 0.7128555
Class: Monocytes 0.4000000 1.0000000 1.0000000 0.9802632 1.0000000 0.4000000 0.5714286 0.0324675 0.0129870 0.0129870 0.7000000
Class: Myeloblasts 0.2413793 0.9569892 0.3684211 0.9238754 0.3684211 0.2413793 0.2916667 0.0941558 0.0227273 0.0616883 0.5991843
Class: Myelocytes 1.0000000 0.8435374 0.2333333 1.0000000 0.2333333 1.0000000 0.3783784 0.0454545 0.0454545 0.1948052 0.9217687
Class: Neutrophils 0.2142857 1.0000000 1.0000000 0.9639344 1.0000000 0.2142857 0.3529412 0.0454545 0.0097403 0.0097403 0.6071429
Class: Pericytes 0.0000000 1.0000000 NaN 0.9805195 NA 0.0000000 NA 0.0194805 0.0000000 0.0000000 0.5000000
Class: Pre-B 0.0000000 1.0000000 NaN 0.9870130 NA 0.0000000 NA 0.0129870 0.0000000 0.0000000 0.5000000
Class: Pro-B 0.0500000 1.0000000 1.0000000 0.9381107 1.0000000 0.0500000 0.0952381 0.0649351 0.0032468 0.0032468 0.5250000
Class: T-NK 0.0000000 1.0000000 NaN 0.9870130 NA 0.0000000 NA 0.0129870 0.0000000 0.0000000 0.5000000
Prediction/Reference Erythroblasts HSPCs Monoblasts Monocytes Myeloblasts Myelocytes Neutrophils Pericytes Pre-B Pro-B T-NK
Erythroblasts 172 8 2 0 0 0 0 5 0 9 3
HSPCs 0 0 0 0 0 0 0 0 0 3 0
Monoblasts 0 3 7 4 0 0 0 0 1 3 1
Monocytes 0 0 0 4 0 0 0 0 0 0 0
Myeloblasts 0 5 4 0 7 0 0 1 2 0 0
Myelocytes 1 3 2 2 22 14 11 0 1 4 0
Neutrophils 0 0 0 0 0 0 3 0 0 0 0
Pericytes 0 0 0 0 0 0 0 0 0 0 0
Pre-B 0 0 0 0 0 0 0 0 0 0 0
Pro-B 0 0 0 0 0 0 0 0 0 1 0
T-NK 0 0 0 0 0 0 0 0 0 0 0

H1H1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9343365 0.9213074 0.9138795 0.9511916 0.2694938 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9310345 0.9732541 0.7500000 0.9939302 0.7500000 0.9310345 0.8307692 0.0793434 0.0738714 0.0984952 0.9521443
Class: Erythroblasts 0.9746193 0.9925094 0.9795918 0.9906542 0.9795918 0.9746193 0.9770992 0.2694938 0.2626539 0.2681259 0.9835643
Class: Neutrophils 0.9047619 0.9955090 0.9500000 0.9910581 0.9500000 0.9047619 0.9268293 0.0861833 0.0779754 0.0820793 0.9501354
Class: Monoblasts 0.2666667 0.9986034 0.8000000 0.9848485 0.8000000 0.2666667 0.4000000 0.0205198 0.0054720 0.0068399 0.6326350
Class: Pro-B 1.0000000 0.9970972 0.9545455 1.0000000 0.9545455 1.0000000 0.9767442 0.0574555 0.0574555 0.0601915 0.9985486
Class: HSPCs 0.8437500 0.9971388 0.9310345 0.9928775 0.9310345 0.8437500 0.8852459 0.0437756 0.0369357 0.0396717 0.9204444
Class: Pericytes 0.3333333 1.0000000 1.0000000 0.9972603 1.0000000 0.3333333 0.5000000 0.0041040 0.0013680 0.0013680 0.6666667
Class: Myelocytes 0.9485714 0.9784173 0.9325843 0.9837251 0.9325843 0.9485714 0.9405099 0.2393981 0.2270862 0.2435021 0.9634943
Class: Monocytes 0.9166667 0.9924127 0.9295775 0.9909091 0.9295775 0.9166667 0.9230769 0.0984952 0.0902873 0.0971272 0.9545397
Class: Pre-B 1.0000000 0.9985653 0.9714286 1.0000000 0.9714286 1.0000000 0.9855072 0.0465116 0.0465116 0.0478796 0.9992826
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0547196 0.0547196 0.0547196 1.0000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 54 1 0 8 0 0 0 7 2 0 0
Erythroblasts 0 192 0 0 0 3 0 0 1 0 0
Neutrophils 0 0 57 0 0 0 0 2 1 0 0
Monoblasts 0 0 0 4 0 0 0 0 1 0 0
Pro-B 0 0 0 0 42 2 0 0 0 0 0
HSPCs 0 1 0 0 0 27 1 0 0 0 0
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 4 1 6 0 0 0 0 166 1 0 0
Monocytes 0 2 0 3 0 0 0 0 66 0 0
Pre-B 0 0 0 0 0 0 1 0 0 34 0
T-NK 0 0 0 0 0 0 0 0 0 0 40

H1H2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9266055 0.9016384 0.9057467 0.9440855 0.4508519 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9183673 0.9684211 0.8108108 0.9877301 0.8108108 0.9183673 0.8612440 0.1284404 0.1179554 0.1454784 0.9433942
Class: Erythroblasts 0.9941860 0.9785203 0.9743590 0.9951456 0.9743590 0.9941860 0.9841727 0.4508519 0.4482307 0.4600262 0.9863532
Class: Neutrophils 0.8888889 0.9973475 0.8000000 0.9986720 0.8000000 0.8888889 0.8421053 0.0117955 0.0104849 0.0131062 0.9431182
Class: Monoblasts 0.2424242 0.9986301 0.8888889 0.9668435 0.8888889 0.2424242 0.3809524 0.0432503 0.0104849 0.0117955 0.6205272
Class: Pro-B 1.0000000 0.9973154 0.9000000 1.0000000 0.9000000 1.0000000 0.9473684 0.0235911 0.0235911 0.0262123 0.9986577
Class: HSPCs 0.7826087 0.9986486 0.9473684 0.9932796 0.9473684 0.7826087 0.8571429 0.0301442 0.0235911 0.0249017 0.8906287
Class: Pericytes 0.3750000 1.0000000 1.0000000 0.9934211 1.0000000 0.3750000 0.5454545 0.0104849 0.0039318 0.0039318 0.6875000
Class: Myelocytes 0.7857143 0.9836735 0.6470588 0.9917695 0.6470588 0.7857143 0.7096774 0.0366972 0.0288336 0.0445609 0.8846939
Class: Monocytes 1.0000000 0.9886202 0.8823529 1.0000000 0.8823529 1.0000000 0.9375000 0.0786370 0.0786370 0.0891219 0.9943101
Class: Pre-B 0.9620253 1.0000000 1.0000000 0.9956332 1.0000000 0.9620253 0.9806452 0.1035387 0.0996068 0.0996068 0.9810127
Class: T-NK 0.9841270 1.0000000 1.0000000 0.9985735 1.0000000 0.9841270 0.9920000 0.0825688 0.0812582 0.0812582 0.9920635
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 90 0 0 17 0 1 0 3 0 0 0
Erythroblasts 0 342 0 1 0 2 2 2 0 2 0
Neutrophils 0 0 8 0 0 0 0 1 0 1 0
Monoblasts 0 0 0 8 0 1 0 0 0 0 0
Pro-B 0 0 0 0 18 1 0 0 0 0 1
HSPCs 0 0 0 0 0 18 1 0 0 0 0
Pericytes 0 0 0 0 0 0 3 0 0 0 0
Myelocytes 8 2 1 1 0 0 0 22 0 0 0
Monocytes 0 0 0 6 0 0 2 0 60 0 0
Pre-B 0 0 0 0 0 0 0 0 0 76 0
T-NK 0 0 0 0 0 0 0 0 0 0 62

H1H3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9015544 0.8737846 0.8673835 0.9293888 0.3419689 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.8875000 0.9673203 0.8765432 0.9704918 0.8765432 0.8875000 0.8819876 0.2072539 0.1839378 0.2098446 0.9274101
Class: Erythroblasts 0.9848485 0.9803150 0.9629630 0.9920319 0.9629630 0.9848485 0.9737828 0.3419689 0.3367876 0.3497409 0.9825817
Class: Neutrophils 0.9090909 0.9945055 0.9090909 0.9945055 0.9090909 0.9090909 0.9090909 0.0569948 0.0518135 0.0569948 0.9517982
Class: Monoblasts 0.4000000 1.0000000 1.0000000 0.9601064 1.0000000 0.4000000 0.5714286 0.0647668 0.0259067 0.0259067 0.7000000
Class: Pro-B 0.8000000 0.9973753 0.8000000 0.9973753 0.8000000 0.8000000 0.8000000 0.0129534 0.0103627 0.0129534 0.8986877
Class: HSPCs 1.0000000 0.9973545 0.8888889 1.0000000 0.8888889 1.0000000 0.9411765 0.0207254 0.0207254 0.0233161 0.9986772
Class: Pericytes 0.0000000 1.0000000 NaN 0.9974093 NA 0.0000000 NA 0.0025907 0.0000000 0.0000000 0.5000000
Class: Myelocytes 0.9156627 0.9636964 0.8735632 0.9765886 0.8735632 0.9156627 0.8941176 0.2150259 0.1968912 0.2253886 0.9396795
Class: Monocytes 1.0000000 0.9785523 0.6190476 1.0000000 0.6190476 1.0000000 0.7647059 0.0336788 0.0336788 0.0544041 0.9892761
Class: Pre-B 0.9166667 1.0000000 1.0000000 0.9973333 1.0000000 0.9166667 0.9565217 0.0310881 0.0284974 0.0284974 0.9583333
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0129534 0.0129534 0.0129534 1.0000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 71 0 0 7 0 0 0 3 0 0 0
Erythroblasts 1 130 0 0 1 0 0 2 0 1 0
Neutrophils 0 0 20 0 0 0 0 2 0 0 0
Monoblasts 0 0 0 10 0 0 0 0 0 0 0
Pro-B 0 1 0 0 4 0 0 0 0 0 0
HSPCs 0 1 0 0 0 8 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 0 0 0 0
Myelocytes 8 0 2 1 0 0 0 76 0 0 0
Monocytes 0 0 0 7 0 0 1 0 13 0 0
Pre-B 0 0 0 0 0 0 0 0 0 11 0
T-NK 0 0 0 0 0 0 0 0 0 0 5

H2H1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.8536252 0.8248576 0.825893 0.8784652 0.2694938 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9827586 0.9331352 0.5588235 0.9984102 0.5588235 0.9827586 0.7125000 0.0793434 0.0779754 0.1395349 0.9579469
Class: Erythroblasts 0.9543147 0.9812734 0.9494949 0.9831144 0.9494949 0.9543147 0.9518987 0.2694938 0.2571819 0.2708618 0.9677941
Class: Neutrophils 0.4920635 1.0000000 1.0000000 0.9542857 1.0000000 0.4920635 0.6595745 0.0861833 0.0424077 0.0424077 0.7460317
Class: Monoblasts 0.4666667 0.9818436 0.3500000 0.9887482 0.3500000 0.4666667 0.4000000 0.0205198 0.0095759 0.0273598 0.7242551
Class: Pro-B 0.8095238 0.9985486 0.9714286 0.9885057 0.9714286 0.8095238 0.8831169 0.0574555 0.0465116 0.0478796 0.9040362
Class: HSPCs 0.7500000 1.0000000 1.0000000 0.9886846 1.0000000 0.7500000 0.8571429 0.0437756 0.0328317 0.0328317 0.8750000
Class: Pericytes 0.6666667 1.0000000 1.0000000 0.9986283 1.0000000 0.6666667 0.8000000 0.0041040 0.0027360 0.0027360 0.8333333
Class: Myelocytes 0.8228571 0.9442446 0.8228571 0.9442446 0.8228571 0.8228571 0.8228571 0.2393981 0.1969904 0.2393981 0.8835509
Class: Monocytes 0.8750000 0.9924127 0.9264706 0.9864253 0.9264706 0.8750000 0.9000000 0.0984952 0.0861833 0.0930233 0.9337064
Class: Pre-B 1.0000000 0.9985653 0.9714286 1.0000000 0.9714286 1.0000000 0.9855072 0.0465116 0.0465116 0.0478796 0.9992826
Class: T-NK 1.0000000 0.9985528 0.9756098 1.0000000 0.9756098 1.0000000 0.9876543 0.0547196 0.0547196 0.0560876 0.9992764
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 57 2 0 8 0 3 0 31 1 0 0
Erythroblasts 0 188 0 0 4 4 1 0 1 0 0
Neutrophils 0 0 31 0 0 0 0 0 0 0 0
Monoblasts 1 3 0 7 2 0 0 0 7 0 0
Pro-B 0 0 0 0 34 1 0 0 0 0 0
HSPCs 0 0 0 0 0 24 0 0 0 0 0
Pericytes 0 0 0 0 0 0 2 0 0 0 0
Myelocytes 0 2 29 0 0 0 0 144 0 0 0
Monocytes 0 2 3 0 0 0 0 0 63 0 0
Pre-B 0 0 0 0 1 0 0 0 0 34 0
T-NK 0 0 0 0 1 0 0 0 0 0 40

H2H2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9397117 0.9191074 0.9203996 0.9555269 0.4508519 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9795918 0.9624060 0.7933884 0.9968847 0.7933884 0.9795918 0.8767123 0.1284404 0.1258191 0.1585845 0.9709989
Class: Erythroblasts 0.9970930 0.9832936 0.9800000 0.9975787 0.9800000 0.9970930 0.9884726 0.4508519 0.4495413 0.4587156 0.9901933
Class: Neutrophils 0.4444444 1.0000000 1.0000000 0.9934124 1.0000000 0.4444444 0.6153846 0.0117955 0.0052425 0.0052425 0.7222222
Class: Monoblasts 0.5151515 0.9931507 0.7727273 0.9784076 0.7727273 0.5151515 0.6181818 0.0432503 0.0222805 0.0288336 0.7541511
Class: Pro-B 0.9444444 1.0000000 1.0000000 0.9986595 1.0000000 0.9444444 0.9714286 0.0235911 0.0222805 0.0222805 0.9722222
Class: HSPCs 0.6521739 1.0000000 1.0000000 0.9893048 1.0000000 0.6521739 0.7894737 0.0301442 0.0196592 0.0196592 0.8260870
Class: Pericytes 0.8750000 1.0000000 1.0000000 0.9986772 1.0000000 0.8750000 0.9333333 0.0104849 0.0091743 0.0091743 0.9375000
Class: Myelocytes 0.6428571 0.9931973 0.7826087 0.9864865 0.7826087 0.6428571 0.7058824 0.0366972 0.0235911 0.0301442 0.8180272
Class: Monocytes 0.9833333 0.9957326 0.9516129 0.9985735 0.9516129 0.9833333 0.9672131 0.0786370 0.0773263 0.0812582 0.9895330
Class: Pre-B 0.9873418 1.0000000 1.0000000 0.9985401 1.0000000 0.9873418 0.9936306 0.1035387 0.1022280 0.1022280 0.9936709
Class: T-NK 1.0000000 0.9985714 0.9843750 1.0000000 0.9843750 1.0000000 0.9921260 0.0825688 0.0825688 0.0838794 0.9992857
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 96 1 0 15 0 1 0 8 0 0 0
Erythroblasts 0 343 0 0 0 4 0 2 0 1 0
Neutrophils 0 0 4 0 0 0 0 0 0 0 0
Monoblasts 2 0 0 17 0 2 0 0 1 0 0
Pro-B 0 0 0 0 17 0 0 0 0 0 0
HSPCs 0 0 0 0 0 15 0 0 0 0 0
Pericytes 0 0 0 0 0 0 7 0 0 0 0
Myelocytes 0 0 5 0 0 0 0 18 0 0 0
Monocytes 0 0 0 1 1 0 1 0 59 0 0
Pre-B 0 0 0 0 0 0 0 0 0 78 0
T-NK 0 0 0 0 0 1 0 0 0 0 63

H2H3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.8756477 0.8394844 0.8385259 0.9068715 0.3419689 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9750000 0.9215686 0.7647059 0.9929577 0.7647059 0.9750000 0.8571429 0.2072539 0.2020725 0.2642487 0.9482843
Class: Erythroblasts 0.9924242 0.9763780 0.9562044 0.9959839 0.9562044 0.9924242 0.9739777 0.3419689 0.3393782 0.3549223 0.9844011
Class: Neutrophils 0.5909091 1.0000000 1.0000000 0.9758713 1.0000000 0.5909091 0.7428571 0.0569948 0.0336788 0.0336788 0.7954545
Class: Monoblasts 0.6000000 0.9889197 0.7894737 0.9727520 0.7894737 0.6000000 0.6818182 0.0647668 0.0388601 0.0492228 0.7944598
Class: Pro-B 0.4000000 0.9973753 0.6666667 0.9921671 0.6666667 0.4000000 0.5000000 0.0129534 0.0051813 0.0077720 0.6986877
Class: HSPCs 0.6250000 1.0000000 1.0000000 0.9921260 1.0000000 0.6250000 0.7692308 0.0207254 0.0129534 0.0129534 0.8125000
Class: Pericytes 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0025907 0.0025907 0.0025907 1.0000000
Class: Myelocytes 0.7831325 0.9702970 0.8783784 0.9423077 0.8783784 0.7831325 0.8280255 0.2150259 0.1683938 0.1917098 0.8767148
Class: Monocytes 0.9230769 0.9892761 0.7500000 0.9972973 0.7500000 0.9230769 0.8275862 0.0336788 0.0310881 0.0414508 0.9561765
Class: Pre-B 0.9166667 1.0000000 1.0000000 0.9973333 1.0000000 0.9166667 0.9565217 0.0310881 0.0284974 0.0284974 0.9583333
Class: T-NK 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0129534 0.0129534 0.0129534 1.0000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 78 0 0 7 1 0 0 16 0 0 0
Erythroblasts 0 131 0 0 2 2 0 1 0 1 0
Neutrophils 0 0 13 0 0 0 0 0 0 0 0
Monoblasts 2 0 0 15 0 1 0 0 1 0 0
Pro-B 0 1 0 0 2 0 0 0 0 0 0
HSPCs 0 0 0 0 0 5 0 0 0 0 0
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 0 0 9 0 0 0 0 65 0 0 0
Monocytes 0 0 0 3 0 0 0 1 12 0 0
Pre-B 0 0 0 0 0 0 0 0 0 11 0
T-NK 0 0 0 0 0 0 0 0 0 0 5

H3H1

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.8112175 0.7709952 0.78093 0.8389678 0.2694938 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9827586 0.9658247 0.7125000 0.9984639 0.7125000 0.9827586 0.8260870 0.0793434 0.0779754 0.1094391 0.9742916
Class: Erythroblasts 0.9390863 0.9494382 0.8726415 0.9768786 0.8726415 0.9390863 0.9046455 0.2694938 0.2530780 0.2900137 0.9442622
Class: Neutrophils 0.7619048 0.9970060 0.9600000 0.9779736 0.9600000 0.7619048 0.8495575 0.0861833 0.0656635 0.0683995 0.8794554
Class: Monoblasts 0.4666667 0.9497207 0.1627907 0.9883721 0.1627907 0.4666667 0.2413793 0.0205198 0.0095759 0.0588235 0.7081937
Class: Pro-B 0.5952381 1.0000000 1.0000000 0.9759207 1.0000000 0.5952381 0.7462687 0.0574555 0.0341997 0.0341997 0.7976190
Class: HSPCs 0.4062500 1.0000000 1.0000000 0.9735376 1.0000000 0.4062500 0.5777778 0.0437756 0.0177839 0.0177839 0.7031250
Class: Pericytes 0.0000000 1.0000000 NaN 0.9958960 NA 0.0000000 NA 0.0041040 0.0000000 0.0000000 0.5000000
Class: Myelocytes 0.9428571 0.9118705 0.7710280 0.9806576 0.7710280 0.9428571 0.8483290 0.2393981 0.2257182 0.2927497 0.9273638
Class: Monocytes 0.5000000 0.9984825 0.9729730 0.9481268 0.9729730 0.5000000 0.6605505 0.0984952 0.0492476 0.0506156 0.7492413
Class: Pre-B 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 0.0465116 0.0465116 0.0465116 1.0000000
Class: T-NK 0.5750000 1.0000000 1.0000000 0.9759887 1.0000000 0.5750000 0.7301587 0.0547196 0.0314637 0.0314637 0.7875000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 57 2 0 8 1 3 0 9 0 0 0
Erythroblasts 0 185 0 0 5 13 3 0 1 0 5
Neutrophils 0 0 48 0 0 0 0 1 1 0 0
Monoblasts 0 2 0 7 9 2 0 0 19 0 4
Pro-B 0 0 0 0 25 0 0 0 0 0 0
HSPCs 0 0 0 0 0 13 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 0 0 0 0
Myelocytes 1 8 15 0 2 0 0 165 15 0 8
Monocytes 0 0 0 0 0 1 0 0 36 0 0
Pre-B 0 0 0 0 0 0 0 0 0 34 0
T-NK 0 0 0 0 0 0 0 0 0 0 23

H3H2

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.8204456 0.7562914 0.7913346 0.8470538 0.4508519 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9489796 0.9548872 0.7560976 0.9921875 0.7560976 0.9489796 0.8416290 0.1284404 0.1218873 0.1612058 0.9519334
Class: Erythroblasts 0.9941860 0.9284010 0.9193548 0.9948849 0.9193548 0.9941860 0.9553073 0.4508519 0.4482307 0.4875491 0.9612935
Class: Neutrophils 0.7777778 0.9946950 0.6363636 0.9973404 0.6363636 0.7777778 0.7000000 0.0117955 0.0091743 0.0144168 0.8862364
Class: Monoblasts 0.3939394 0.9356164 0.2166667 0.9715505 0.2166667 0.3939394 0.2795699 0.0432503 0.0170380 0.0786370 0.6647779
Class: Pro-B 0.5000000 1.0000000 1.0000000 0.9880637 1.0000000 0.5000000 0.6666667 0.0235911 0.0117955 0.0117955 0.7500000
Class: HSPCs 0.3043478 0.9959459 0.7000000 0.9787517 0.7000000 0.3043478 0.4242424 0.0301442 0.0091743 0.0131062 0.6501469
Class: Pericytes 0.1250000 1.0000000 1.0000000 0.9908136 1.0000000 0.1250000 0.2222222 0.0104849 0.0013106 0.0013106 0.5625000
Class: Myelocytes 0.8214286 0.9714286 0.5227273 0.9930459 0.5227273 0.8214286 0.6388889 0.0366972 0.0301442 0.0576671 0.8964286
Class: Monocytes 0.5000000 0.9985775 0.9677419 0.9590164 0.9677419 0.5000000 0.6593407 0.0786370 0.0393185 0.0406291 0.7492888
Class: Pre-B 0.9620253 0.9985380 0.9870130 0.9956268 0.9870130 0.9620253 0.9743590 0.1035387 0.0996068 0.1009174 0.9802817
Class: T-NK 0.3968254 1.0000000 1.0000000 0.9485095 1.0000000 0.3968254 0.5681818 0.0825688 0.0327654 0.0327654 0.6984127
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 93 0 0 19 1 3 0 3 1 0 3
Erythroblasts 0 342 0 0 1 8 5 1 0 2 13
Neutrophils 0 0 7 0 0 0 0 1 2 1 0
Monoblasts 1 0 0 13 6 5 0 0 22 0 13
Pro-B 0 0 0 0 9 0 0 0 0 0 0
HSPCs 0 0 0 0 0 7 1 0 0 0 2
Pericytes 0 0 0 0 0 0 1 0 0 0 0
Myelocytes 4 2 2 1 0 0 1 23 5 0 6
Monocytes 0 0 0 0 1 0 0 0 30 0 0
Pre-B 0 0 0 0 0 0 0 0 0 76 1
T-NK 0 0 0 0 0 0 0 0 0 0 25

H3H3

Accuracy Kappa AccuracyLower AccuracyUpper AccuracyNull AccuracyPValue
0.9248705 0.9028526 0.8938822 0.9491098 0.3419689 0
Sensitivity Specificity Pos Pred Value Neg Pred Value Precision Recall F1 Prevalence Detection Rate Detection Prevalence Balanced Accuracy
Class: Myeloblasts 0.9875000 0.9673203 0.8876404 0.9966330 0.8876404 0.9875000 0.9349112 0.2072539 0.2046632 0.2305699 0.9774101
Class: Erythroblasts 1.0000000 0.9763780 0.9565217 1.0000000 0.9565217 1.0000000 0.9777778 0.3419689 0.3419689 0.3575130 0.9881890
Class: Neutrophils 0.8181818 1.0000000 1.0000000 0.9891304 1.0000000 0.8181818 0.9000000 0.0569948 0.0466321 0.0466321 0.9090909
Class: Monoblasts 0.8400000 0.9861496 0.8076923 0.9888889 0.8076923 0.8400000 0.8235294 0.0647668 0.0544041 0.0673575 0.9130748
Class: Pro-B 0.2000000 1.0000000 1.0000000 0.9896104 1.0000000 0.2000000 0.3333333 0.0129534 0.0025907 0.0025907 0.6000000
Class: HSPCs 0.3750000 1.0000000 1.0000000 0.9869452 1.0000000 0.3750000 0.5454545 0.0207254 0.0077720 0.0077720 0.6875000
Class: Pericytes 0.0000000 1.0000000 NaN 0.9974093 NA 0.0000000 NA 0.0025907 0.0000000 0.0000000 0.5000000
Class: Myelocytes 0.9397590 0.9768977 0.9176471 0.9833887 0.9176471 0.9397590 0.9285714 0.2150259 0.2020725 0.2202073 0.9583284
Class: Monocytes 0.8461538 0.9973190 0.9166667 0.9946524 0.9166667 0.8461538 0.8800000 0.0336788 0.0284974 0.0310881 0.9217364
Class: Pre-B 0.9166667 1.0000000 1.0000000 0.9973333 1.0000000 0.9166667 0.9565217 0.0310881 0.0284974 0.0284974 0.9583333
Class: T-NK 0.6000000 1.0000000 1.0000000 0.9947781 1.0000000 0.6000000 0.7500000 0.0129534 0.0077720 0.0077720 0.8000000
Prediction/Reference Myeloblasts Erythroblasts Neutrophils Monoblasts Pro-B HSPCs Pericytes Myelocytes Monocytes Pre-B T-NK
Myeloblasts 79 0 0 3 0 2 1 4 0 0 0
Erythroblasts 0 132 0 0 2 2 0 1 0 1 0
Neutrophils 0 0 18 0 0 0 0 0 0 0 0
Monoblasts 0 0 0 21 1 1 0 0 2 0 1
Pro-B 0 0 0 0 1 0 0 0 0 0 0
HSPCs 0 0 0 0 0 3 0 0 0 0 0
Pericytes 0 0 0 0 0 0 0 0 0 0 0
Myelocytes 1 0 4 0 1 0 0 78 0 0 1
Monocytes 0 0 0 1 0 0 0 0 11 0 0
Pre-B 0 0 0 0 0 0 0 0 0 11 0
T-NK 0 0 0 0 0 0 0 0 0 0 3
---
title: "Spectral Distances"
output: 
  flexdashboard::flex_dashboard:
    orientation: row
    vertical_layout: scroll
    source_code: embed
    social: ["twitter", "menu"]
---

```{r setup, include=FALSE}
library(flexdashboard)
library(highcharter)
library(reshape2)
library(dplyr)
library(broom)
library(d3heatmap)
library(printr)
```

```{r}
load("Data/Tables.RData")
load("Data/Accs.RData")
load("Data/SpecDists.RData")
load("Data/PrimalData.RData")
load("Data/DualData.RData")
```

Coding
==========

Row {data-height=800}
----------

```{r, dpi=240}
knitr::include_url("codemarkdown.html", height = "800px")
```

Primal Spectral Distance
==========

Row
----------

### Primal Spectral Distance

Here is a heatmap of the spectral distances between the Primal Classification Hypegraphs (or Model 1 Hypergraphs), where vertices are cells and hyperedges are cell fates. The hyeprgraphs have been sorted in the heatmap such the species tested on is grouped together. It is clear to see, that all hypergraphs tested on the same species have low spectral distance between them, except for Human 3 who's spectral distance is much closer to mice than it is to humans.

Row {data-height=500}
----------

### Heatmap

```{r}
d3heatmap(sd.p, symm = TRUE, colors = c("green", "red"))
```

### UMAP Representation of Spectral Projection

```{R}
x <- c("Trained On:", "Tested On:")
y <- sprintf("{point.%s:.2f}", c("Train", "Test"))
tltip <- tooltip_table(x,y)

primal.data %>% 
  hchart("point", hcaes(x = UMAP1, y = UMAP2, group = testspec)) %>% 
  hc_colors(c("blue", "red")) %>%
  hc_xAxis(title = list(text = "UMAP 1")) %>%
  hc_yAxis(title = list(text = "UMAP 2")) %>%
  hc_tooltip(useHTML = TRUE, headerFormat = "", pointFormat = tltip)
```

Row
----------

Dual Spectral Distance
==========

Row
----------

### Dual Spectral Distance

Here is a heatmap of the spectral distances between the Dual Classification Hypegraphs (or Model 2 Hypergraphs), where vertices are cell fates and hyperedges are cells. It is harder to immediately analyse these resluts by inspection. There is a definite pattern to the data with respect to the species the classifiers were tested and trained on. It is interesting to note that the spectral distances between all hypergraphs where the classifier was both tested and trained on the same species is low. Oimilarly to the primal case, the pattern in the data is broken by Human 3. The hypergraphs of classifiers trained on Human 3 but then tested on mice has a starkly different heatmap to other similar classifiers.

Row {data-height=500}
----------

### Heatmap

```{r}
d3heatmap(sd.d, symm = TRUE, colors = c("green", "red"))
```

### A Statisic

```{R}
x <- c("Trained On:", "Tested On:")
y <- sprintf("{point.%s:.2f}", c("Train", "Test"))
tltip <- tooltip_table(x,y)

dual.data %>% 
  hchart("point", hcaes(x = UMAP1, y = UMAP2, group = Interspec)) %>% 
  hc_colors(c("black", "red", "blue")) %>%
  hc_xAxis(title = list(text = "UMAP 1")) %>%
  hc_yAxis(title = list(text = "UMAP 2")) %>%
  hc_tooltip(useHTML = TRUE, headerFormat = "", pointFormat = tltip)
```

Confidence/Accuracy
==========

Row
----------

### **Balanced Accuracy Compared to Spectral Distance From the Disconnected Hypergraph**
```{r}
p.data <- data.frame(sd = unlist(spectral_distances$disconnected), acc = unlist(bal_accs))
p.data$train <- c(rep(c("Mouse 1", "Mouse 2", "Mouse 3"), 2, each = 3),rep(c("Human 1", "Human 2", "Human 3"), 2, each = 3))

p.data$test <- c(rep(c("Mouse 1", "Mouse 2", "Mouse 3"), 3), rep(c("Human 1", "Human 2", "Human 3"), 3), rep(c("Mouse 1", "Mouse 2", "Mouse 3"), 3), rep(c("Human 1", "Human 2", "Human 3"), 3))

p.data$trainspec <- rep(c("Mouse", "Human"), each = 18)
p.data$testspec <- rep(c("Mouse", "Human"), each = 9, 2)

x <- c("Trained On:", "Tested On:", "Balanced Accuracy:", "Spectral Distance:")
y <- sprintf("{point.%s:.2f}", c("train", "test", "acc", "sd"))
tltip <- tooltip_table(x,y)

model.mouse <- lm(sd ~ acc, data = p.data[which(p.data$trainspec == "Mouse"),])
fit.mouse <- augment(model.mouse) %>% arrange(acc)

model.human <- lm(sd ~ acc, data = p.data[which(p.data$trainspec == "Human"),])
fit.human <- augment(model.human) %>% arrange(acc)

p.data %>%
  hchart("point", hcaes(x = acc, y = sd, group = trainspec)) %>%
  hc_colors(c("blue", "red")) %>%
  hc_add_series(fit.human, type = "line", hcaes(x = acc, y = .fitted), name = "Human Fit", id = "humanfit")%>%
  hc_add_series(fit.mouse, type = "line", hcaes(x = acc, y = .fitted), name = "Mouse Fit", id = "mousefit")%>%
  hc_xAxis(title = list(text = "Balanced Accurcay")) %>%
  hc_yAxis(title = list(text = "Spectral Distance From the Disconnected Hypergraph")) %>%
  hc_tooltip(useHTML = TRUE, headerFormat = "", pointFormat = tltip)
```

Row
----------

### **Average Balanced Accuracy of Intraspecies Classifications**
```{r}
gauge(round(mean(p.data$acc[which(p.data$testspec == p.data$trainspec)]), digits = 2),
      min = 0,
      max = 1,
      gaugeSectors(success = c(0.85, 1),
                   warning = c(0.7, 0.85),
                   danger = c(0, 0.7)
                   )
      )
```

### **Average Spectral Distance From the Disconnected Hypergraph of Intraspecies Classifications**

```{r}
valueBox(round(mean(p.data$sd[which(p.data$testspec == p.data$trainspec)]), digits = 2))
```

### **Average Balanced Accuracy of Interspecies Classifications**
```{r}
gauge(round(mean(p.data$acc[which(p.data$testspec != p.data$trainspec)]), digits = 2),
      min = 0,
      max = 1,
      gaugeSectors(success = c(0.85, 1),
                   warning = c(0.7, 0.85),
                   danger = c(0, 0.7)
                   )
      )
```

### **Average Spectral Distance From the Disconnected Hypergraph of Interspecies Classifications**

```{r}
valueBox(round(mean(p.data$sd[which(p.data$testspec != p.data$trainspec)]), digits = 2))
```

Row {.tabset .tabset-fade data-height=1000}
----------

### M1M1
```{R}
as.table(conf_mat$mm[[1]][[1]]$overall[-7])

conf_mat$mm[[1]][[1]]$byClass

conf_mat$mm[[1]][[1]]$table
```

### M1M2
```{R}
as.table(conf_mat$mm[[1]][[2]]$overall[-7])

conf_mat$mm[[1]][[2]]$byClass

conf_mat$mm[[1]][[2]]$table
```

### M1M3
```{R}
as.table(conf_mat$mm[[1]][[3]]$overall[-7])

conf_mat$mm[[1]][[3]]$byClass

conf_mat$mm[[1]][[3]]$table
```

### M2M1
```{R}
as.table(conf_mat$mm[[2]][[1]]$overall[-7])

conf_mat$mm[[2]][[1]]$byClass

conf_mat$mm[[2]][[1]]$table
```

### M2M2
```{R}
as.table(conf_mat$mm[[2]][[2]]$overall[-7])

conf_mat$mm[[2]][[2]]$byClass

conf_mat$mm[[2]][[2]]$table
```

### M2M3
```{R}
as.table(conf_mat$mm[[2]][[3]]$overall[-7])

conf_mat$mm[[2]][[3]]$byClass

conf_mat$mm[[2]][[3]]$table
```

### M3M1
```{R}
as.table(conf_mat$mm[[3]][[1]]$overall[-7])

conf_mat$mm[[3]][[1]]$byClass

conf_mat$mm[[3]][[1]]$table
```

### M3M2
```{R}
as.table(conf_mat$mm[[3]][[2]]$overall[-7])

conf_mat$mm[[3]][[2]]$byClass

conf_mat$mm[[3]][[2]]$table
```

### M3M3
```{R}
as.table(conf_mat$mm[[3]][[3]]$overall[-7])

conf_mat$mm[[3]][[3]]$byClass

conf_mat$mm[[3]][[3]]$table
```

### M1H1
```{R}
as.table(conf_mat$mh[[1]][[1]]$overall[-7])

conf_mat$mh[[1]][[1]]$byClass

conf_mat$mh[[1]][[1]]$table
```

### M1H2
```{R}
as.table(conf_mat$mh[[1]][[2]]$overall[-7])

conf_mat$mh[[1]][[2]]$byClass

conf_mat$mh[[1]][[2]]$table
```

### M1H3
```{R}
as.table(conf_mat$mh[[1]][[3]]$overall[-7])

conf_mat$mh[[1]][[3]]$byClass

conf_mat$mh[[1]][[3]]$table
```

### M2H1
```{R}
as.table(conf_mat$mh[[2]][[1]]$overall[-7])

conf_mat$mh[[2]][[1]]$byClass

conf_mat$mh[[2]][[1]]$table
```

### M2H2
```{R}
as.table(conf_mat$mh[[2]][[2]]$overall[-7])

conf_mat$mh[[2]][[2]]$byClass

conf_mat$mh[[2]][[2]]$table
```

### M2H3
```{R}
as.table(conf_mat$mh[[2]][[3]]$overall[-7])

conf_mat$mh[[2]][[3]]$byClass

conf_mat$mh[[2]][[3]]$table
```

### M3H1
```{R}
as.table(conf_mat$mh[[3]][[1]]$overall[-7])

conf_mat$mh[[3]][[1]]$byClass

conf_mat$mh[[3]][[1]]$table
```

### M3H2
```{R}
as.table(conf_mat$mh[[3]][[2]]$overall[-7])

conf_mat$mh[[3]][[2]]$byClass

conf_mat$mh[[3]][[2]]$table
```

### M3H3
```{R}
as.table(conf_mat$mh[[3]][[3]]$overall[-7])

conf_mat$mh[[3]][[3]]$byClass

conf_mat$mh[[3]][[3]]$table
```

### H1M1
```{R}
as.table(conf_mat$hm[[1]][[1]]$overall[-7])

conf_mat$hm[[1]][[1]]$byClass

conf_mat$hm[[1]][[1]]$table
```

### H1M2
```{R}
as.table(conf_mat$hm[[1]][[2]]$overall[-7])

conf_mat$hm[[1]][[2]]$byClass

conf_mat$hm[[1]][[2]]$table
```

### H1M3
```{R}
as.table(conf_mat$hm[[1]][[3]]$overall[-7])

conf_mat$hm[[1]][[3]]$byClass

conf_mat$hm[[1]][[3]]$table
```

### H2M1
```{R}
as.table(conf_mat$hm[[2]][[1]]$overall[-7])

conf_mat$hm[[2]][[1]]$byClass

conf_mat$hm[[2]][[1]]$table
```

### H2M2
```{R}
as.table(conf_mat$hm[[2]][[2]]$overall[-7])

conf_mat$hm[[2]][[2]]$byClass

conf_mat$hm[[2]][[2]]$table
```

### H2M3
```{R}
as.table(conf_mat$hm[[2]][[3]]$overall[-7])

conf_mat$hm[[2]][[3]]$byClass

conf_mat$hm[[2]][[3]]$table
```

### H3M1
```{R}
as.table(conf_mat$hm[[3]][[1]]$overall[-7])

conf_mat$hm[[3]][[1]]$byClass

conf_mat$hm[[3]][[1]]$table
```

### H3M2
```{R}
as.table(conf_mat$hm[[3]][[2]]$overall[-7])

conf_mat$hm[[3]][[2]]$byClass

conf_mat$hm[[3]][[2]]$table
```

### H3M3
```{R}
as.table(conf_mat$hm[[3]][[3]]$overall[-7])

conf_mat$hm[[3]][[3]]$byClass

conf_mat$hm[[3]][[3]]$table
```

### H1H1
```{R}
as.table(conf_mat$hh[[1]][[1]]$overall[-7])

conf_mat$hh[[1]][[1]]$byClass

conf_mat$hh[[1]][[1]]$table
```

### H1H2
```{R}
as.table(conf_mat$hh[[1]][[2]]$overall[-7])

conf_mat$hh[[1]][[2]]$byClass

conf_mat$hh[[1]][[2]]$table
```

### H1H3
```{R}
as.table(conf_mat$hh[[1]][[3]]$overall[-7])

conf_mat$hh[[1]][[3]]$byClass

conf_mat$hh[[1]][[3]]$table
```

### H2H1
```{R}
as.table(conf_mat$hh[[2]][[1]]$overall[-7])

conf_mat$hh[[2]][[1]]$byClass

conf_mat$hh[[2]][[1]]$table
```

### H2H2
```{R}
as.table(conf_mat$hh[[2]][[2]]$overall[-7])

conf_mat$hh[[2]][[2]]$byClass

conf_mat$hh[[2]][[2]]$table
```

### H2H3
```{R}
as.table(conf_mat$hh[[2]][[3]]$overall[-7])

conf_mat$hh[[2]][[3]]$byClass

conf_mat$hh[[2]][[3]]$table
```

### H3H1
```{R}
as.table(conf_mat$hh[[3]][[1]]$overall[-7])

conf_mat$hh[[3]][[1]]$byClass

conf_mat$hh[[3]][[1]]$table
```

### H3H2
```{R}
as.table(conf_mat$hh[[3]][[2]]$overall[-7])

conf_mat$hh[[3]][[2]]$byClass

conf_mat$hh[[3]][[2]]$table
```

### H3H3
```{R}
as.table(conf_mat$hh[[3]][[3]]$overall[-7])

conf_mat$hh[[3]][[3]]$byClass

conf_mat$hh[[3]][[3]]$table
```